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EXECUTIVE  SUMMARY 


The  three  tasks  set  forth  for  this  investigation  were  (1)  ana¬ 
lyze  team  operations  and  identify  team  structure  and  processes 
relative  to  the  development  of  team  training,  (2)  determine  the 
applicability  of  the  Interservice  Procedures  for  Instructional 
Systems  Development  (ISD)  to  the  analysis,  design,  and  development 
of  team  instructional  materials,  and  (3)  identify  appropriate  pro¬ 
cedures  for  the  analysis,  design,  and  development  of  team  instruc¬ 
tional  materials. 

The  approach  used  to  conduct  this  study  consisted  of  four 
steps : 

1.  Extrapolate  from  the  research  and  development  lit- 
ature  concepts  and  applications  that  lend  themselves 
to  the  specifying  of  co) lective  training  analysis, 
design  and  development  procedures. 

2.  Identify  procedures  from  the  Interservice  ISD  model 
that  are  applicable  to  collective  training  develop¬ 
ment. 

3.  Review  other  U.S.  Army  and  Department  of  Defense 
specifications,  standards,  handbooks,  regulations, 
etc.,  for  relevance  to  collective  training  develop¬ 
ment. 

4.  Interview  U.S.  Army  training  developers  and  collect 
their  inputs  as  a  basis  for  making  recommendations 
for  collective  training  analysis,  design,  and  devel¬ 
opment  documentation. 

It  was  found  that  none  of  the  ISD  procedures  currently  em¬ 
ployed  are  adequate  as  guidelines  for  team  training.  Critical 
areas  where  documentation  is  deficient  include  collective  front- 
end  analysis  (CFEA) ,  identification  of  types  of  team  learning,  and 
development  of  collective  training  scenarios  that  incorporate 
efficient  learning  principles  and  represent  actual  mission  contin¬ 
gencies.  Recommendations  for  improving  collective  training  analy¬ 
sis,  design,  and  development  are  included. 
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INTRODUCTION 


This  document  is  the  final  report  of  a  study  of  the  "Develop¬ 
ment  of  Analysis,  Design,  and  Development  Techniques  for  Team  ISD." 
The  project  was  approved  by  the  U.S.  Army  Research  Institute  for 
the  Behavioral  and  Social  Sciences  under  Contract  No.  MDA903-79- 
C-0322. 

There  were  three  tasks  set  forth  in  the  contract  statement  of 
work.  The  tasks  were: 

1.  Analyze  team  operations  and  identify  team  structure  and 
processes  relative  to  the  development  of  team  training. 

2.  Determine  the  applicability  of  the  Interservice  Proce¬ 
dures  for  Instructional  Systems  Development  (as  presented 
in  TRADOC  PAMPHLET  350-30)  to  the  analyses,  design,  and 
development  of. team  instructional  materials. 

3.  Identify  appropriate  procedures  for  the  analysis,  design, 
and  development  of  team  instructional  materials. 


BACKGROUND 

A  central  problem  of  achieving  operational  effectiveness  for 
the  military  unit  is  determining  what  and  how  the  unit  of  individ¬ 
uals  is  to  perform  collectively.  The  study  of  the  relations  be¬ 
tween  individuals  and  the  general  operating  environment  consisting 
of  mission,  threat  contingencies,  technology,  and  other  individuals' 
behaviors  has  long  been  a  focus  of  the  human  factors  and  psycholog¬ 
ical  research  communities.  A  considerable  body  of  research  find¬ 
ings  has  accumulated.  However,  when  one  looks  at  this  literature, 
it  reveals  a  fragmented  nature  —  descriptive  of  many  facets  of 
teams  and  team  behaviors,  but  it  does  not  lend  itself  to  be  used  as 
an  analytical  tool  for  addressing  the  central  problem.  There  are 
no  clear  guidelines  for  specifying,  in  precise  language,  what  the 
team's  performance  is  to  be  or  how  the  collection  of  individuals 
is  to  perform. 

Quite  the  contrary  is  true  regarding  the  study  of  the  indi¬ 
vidual  in  an  operating  environment.  Detailed  procedures  for 
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analyzing  and  designing  jobs  and  allocating  job  tasks  address  the 
man-machine  interface  to  ensure  that  individual  capabilities  are 
considered  in  the  design  of  systems  and  equipment.  Considerable 
effort  has  been  placed  on  developing  models  and  procedures  for 
developing  training  materials.  There  is  a  need  for  providing  the 
thorough  documentation  for  team  issues  that  exist  for  individual 
operations  and  training.  This  report  investigates  the  requirement 
for  collective  training  documentation.  The  U.S.  Army  Research  In¬ 
stitute  drew  its  focus  on  this  requirement  for  collective  training 
Instructional  Systems  Development  (ISD)  as  an  extension  of  its  long 
range  program  to  use  tactical  data  systems  to  meet  tactical  training 
needs.  The  first  phase  of  ARI ' s  effort  toward  using  tactical  sys¬ 
tems  in  an  instructional  mode  involved  the  MASSTER  test  122:  "IBCS: 
Automated  Instruction"  project.  This  project  demonstrated  the 
feasibility  of  using  a  prototype  tactical  data  processing  system 
(DEVTOS)  in  a  stand-alone  mode  to  support  unit  training  requirements 

The  second  phase  of  the  ARI  effort  to  employ  tactical  data 
systems  for  instructional  purposes  involved  embedding  training 
that  was  directly  related  to  the  operation  of  the  tactical  system 
itself.  One  benefit  of  embedded  training  is  that  it  can  provide 
training  at  a  unit  level  and  location  thereby  reducing  or  elimi¬ 
nating  the  need  to  send  personnel  away  to  school.  Embedded  train¬ 
ing  also  accomplishes  general  familiarization  with  the  tactical 
data  system  through  a  self-instructional  mode.  That  is,  personnel 
who  are  operators  or  involved  in  maintenance  of  a  tactical  data 
system  are  likely  to  have  little  experience  with  computers;  thus, 
instructional  material  embedded  in  the  tactical  data  system  offers 
an  additional  opportunity  to  become  familiar  with  system  equip¬ 
ment  and  operational  characteristics. 

In  May  1975,  ARI  began  the  development  of  embedded  self- 
instructional  programs  for  users  of  the  TACFIRE  system.  The  basic 
approach  was  to  embed  a  training  subsystem  package  within  the  oper¬ 
ating  TACFIRE  system  and  to  use  the  system  itself  to  train  person¬ 
nel  in  its  operation  and  maintenance.  The  overall  aim  of  that 
effort  was  to  extend  the  scope  of  computer-assisted  instruction 
(CAI)  to  the  development  of  self-instructional  programs  and 


procedures  for  TACFIRE  users.  The  training  goals  of  the  course¬ 
ware  to  be  used  in  the  embedded  mode  were: 

1.  To  present  techniques  to  aid  the  users  in  learning  how 
to  operate  the  system, 

2.  To  exercise  and  update  system  related  skills,  and 

3.  To  provide  on-line  situational  problems  which  enable 
users  to  exercise  all  the  skills  previously  acquired. 
(SDC,  1976) 

TACFIRE  courseware,  using  the  PLANIT  language,  was  developed 
and  produced  in  five  functional  areas.  The  average  course  time 
for  this  individualized,  self-paced,  embedded  training  program  is 
approximately  40  hours  and  covers  an  estimated  25  to  35  percent  of 
the  Battalion  Fire  Direction  Center  operations  (SDC,  1976) . 

A  later  project  investigated  the  application  of  the  embedded 
training  concept  to  total  systems  operations.  The  objective  of 
that  project  was  to  demonstrate  and  evaluate  training  of  TACFIRE 
system  personnel  operating  collectively . 

The  collective  training  was  viewed  as  a  function  of  the  re¬ 
quirement  for  coordinated  activity  within  the  TACFIRE  environment. 
As  a  computerized  command/control  system,  TACFIRE  has  a  number  of 
characteristics  that  are  common  to  all  such  systems.  For  example, 
the  system  is  operated  by  teams  of  people  whose  interaction  with 
each  other  in  the  environment  are  mediated  by  the  computer  complex 
with  associated  input/output  requirements.  Within  this  sophisti¬ 
cated  and  complex  computer-based  weapon  system  environment,  it  is 
essential  for  personnel  to  perform  cooperatively. 

A  major  conclusion  of  that  effort  was  that  an  ISD  model  for 
collective  training  had  not  been  defined.  It  was  suggested  that 
the  key  to  developing  such  a  model  was  to  establish  a  methodology 
for  conducting  a  collective  job/task  analysis.  Until  a  framework 
existed  from  which  to  identify  the  specific  team  task  dimensions 
characteristic  of  job  sequences,  then  the  systematic  development 
of  a  collective  training  curriculum  was  precluded.  The  project 


team  regarded  the  development  and  implementation  of  team  task  analy¬ 
sis  procedures  as  the  primary  problem. 


STATEMENT  OF  THE  PROBLEM 

The  statement  of  work  clearly  expresses  the  problem  addressed 
in  this  study;  that  is,  to  investigate  and  identify  procedural 
documentation  fc-  the  analysis  of  collective  training  requirements 
and  the  design  and  development  of  collective  training  instructional 
materials.  Specifically,  the  individual  ISO  procedures  in  TRADOC 
PAMPHLET  350-30  were  to  be  reviewed  to  determine  their  applicability 
to  a  collective  training  ISD  approach.  Lastly,  new  approaches  to 
collective  training  analysis,  design,  and  development  were  to  be 
identified  for  those  areas  where  procedural  deficiencies  existed. 

As  frequently  happens,  the  problem's  characteristics  and  param¬ 
eters  evolved  as  the  study  progressed.  First,  as  part  of  the  Army 
Training  and  Evaluation  Program  (ARTEP) ,  new  documentation  for 
conducting  collective  front-end  analysis  (CFEA)  has  been  developed 
(TRADOC  PAMPHLET  310-8  (Draft)).  Certainly,  the  procedures  identi¬ 
fied  in  this  pamphlet  should  be  incorporated  in  the  study. 

Second,  the  increasing  emphasis  by  the  Army  on  Skills  Perform¬ 
ance  Aids  (SPA)  led  us  to  review  the  SPA  (an  outgrowth  of  the  Inte¬ 
grated  Technical  Documentation  and  Training  ( ITDT)  program)  docu¬ 
mentation,  particularly  the  front-end  analysis  procedures,  for 
applicability  to  collective  training. 

The  following  questions  were  formulated  to  represent  all  of 
the  major  facets  of  the  problem: 

1.  What  principles  and  concepts,  extracted  from  team  research 
literature,  provide  a  basis  for  the  analysis,  design, 

and  development  of  collective  training? 

2.  Are  the  ISD  procedures  set  forth  in  TRADOC  PAMPHLET  350- 
30  sufficient  guidelines  for  collective  training  ISD? 

3.  Has  the  introduction  of  Skills  Performance  Aids  as  the 
integration  of  technical  documentation  and  training  pro¬ 
vided  a  basis  or  guidelines  for  developing  collective 
training  materials? 
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4. 
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Do  the  Collective  Front-End  Analysis  techniques  contained 
in  TRADOC  PAMPHLET  310-8  (Draft)  provide  sufficient 
detail  to  the  collective  training  developer? 


5.  What  aspects  of  collective  training  analysis,  design,  and 
development  continue  to  present  problems  to  the  collec¬ 
tive  training  developer? 

6.  How  may  remaining  collective  training  analysis,  design, 
and  development  problems  be  resolved? 

Each  of  these  questions  is  addressed  in  the  following  sections 
of  this  document.  Questions  1  through  4  are  answered  in  the  RESULTS 
section.  Question  5  provides  the  context  for  the  CONCLUSIONS. 
Question  6  is  addressed  in  the  RECOMMENDATIONS. 


METHODOLOGY 


The  approach  used  to  conduct  this  study  consisted  of  four 
steps : 

1.  Extrapolate  from  the  research  and  development  liter¬ 
ature  concepts  and  applications  that  lend  themselves 
to  the  specifying  of  collective  training  analysis, 
design  and  development  procedures. 

2.  Identify  procedures  from  the  Interservice  ISD  model 
that  are  applicable  to  collective  training  develop¬ 
ment. 

3.  Review  other  U.S.  Army  and  Department  of  Defense 
specifications,  standards,  handbooks,  regulations, 
etc.,  for  relevance  to  collective  training  development. 

4.  Interview  U.S.  Army  training  developers  and  collect 
their  inputs  as  a  basis  for  making  recommendations 
for  collective  training  analysis,  design,  and  devel¬ 
opment  documentation. 

Step  one  did  not  require  that  a  comprehensive  review  of  the 
R  &  D  literature  be  conducted.  That  task  had  been  performed  and 
reported  in  two  prior  projects,  and  many  of  the  major  contributors 
to  the  field  were  identified.  The  work  of  these  researchers  was 
reviewed.  An  update  check  of  the  literature  was  performed  via 
ERIC  and  Defense  Documentation  Center  searches. 

Steps  two  and  three  involved  analyzing  existing  documentation. 
This  analysis  effort  consisted  of  identifying  the  inputs  and  out¬ 
puts  of  related  procedural  guidelines  and  defining  the  processes 
that  comprised  the  particular  function  being  investigated.  This 
was  true  whether  the  material  dealt  with  individual  training, 
front-end  analysis  (FEA)  or  logistic  support  analysis  (LSA) .  The 
purpose  was  to  those  information  sources  and  documentation  that 
could  either  (1)  be  interfaced  with  collective  training  develop¬ 
ment,  or  (2)  provide  insights  or  perhaps  serve  as  a  model  of  the 
development  of  collective  training  analysis,  design,  or  develop¬ 
ment  guidelines. 
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The  fourth  step  was  to  interview  12  training  developers  from 
the  U.S.  Army  Field  Artillery  School  (USAFAS)  at  Fort  Sill,  Okla¬ 
homa.  The  purpose  of  the  interviews  was  threefold.  First,  the 
interview  formats  were  designed  so  that  the  collective  training 
practices  being  used  at  USAFAS  could  be  defined  while  at  the  same 
time  maintaining  the  context  of  the  individual  ISD  model.  This 
rigid  format  was  employed  because  we  hoped  to  retain  as  much  of 
the  individual  ISD  model's  proceduralization  as  possible  if,  in  fact 
it  was  useful  to  collective  training  developers.  The  second  pur¬ 
pose  of  the  interviews  was  to  identify  the  problems  encountered 
by  the  collective  training  developers.  Third,  the  interviews 
were  used  to  collect  the  recommendations  of  the  training  developers 
in  regard  to  the  analysis,  design,  and  development  of  collective 
training. 

The  following  sections  are  the  products  of  the  data  collection 
and  analysis  performed  in  the  four  steps  described. 
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RESULTS 


As  stated  earlier,  this  section  provides  responses  to  questions 
1  through  4  as  formulated  in  the  Statement  of  the  Problem.  These 
questions  were  as  follows: 

1.  What  principles  and  concepts,  extracted  from  team  research 
literature,  provide  a  basis  for  the  analysis,  design  and 
development  of  collective  training? 

2.  Are  the  ISD  procedures  set  forth  in  TRADOC  PAMPHLET  350- 
30  sufficient  guidelines  for  collective  training  ISD? 

3.  Has  the  introduction  of  Skills  Performance  Aids  as  the 
integration  of  technical  documentation  and  training  pro¬ 
vided  a  basis  or  guidelines  for  developing  collective 
training  materials? 

4.  Do  the  Collective  Front-End  Analysis  techniques  contained 
in  TRADOC  PAMPHLET  310-8  (Draft)  provide  sufficient  detail 
to  the  collective  training  developer? 

Additionally,  the  RESULTS  section  contains  a  summary  of  the 
interviews  that  were  conducted  with  the  personnel  at  Fort  Sill. 

CONTRIBUTION  OF  TEAM  RESEARCH  TO  COLLECTIVE  TRAINING 
ANLYSIS ,  DESIGN,  AND  DEVELOPMENT 

Task  1  called  for  the  analysis  of  team  operation  and  the  iden¬ 
tification  of  team  attributes  relative  to  the  development  of  col¬ 
lective  training.  This  analysis  was  performed  on  the  basis  of  a 
review  of  literature.  A  detailed  discussion  of  the  findings  is 
contained  in  the  interim  report  for  this  project.  However,  it  is 
worthy  to  iterate  the  major  findings  and  conclusions  reached. 

Team  Definition: 

The  first  item  that  was  addressed  was  the  establishment  of  a 
working  definition  of  a  team.  The  definition  needed  not  to  go 
beyond  the  miliary  utilization  of  multi-individual  working  groups. 
The  definition  that  was  accepted  was  set  forth  by  Klaus  and  Glaser 
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(1968)  and  utilized  in  an  earlier  team  training  study  sponsored 
by  ARI  (Thurmond  and  Kribs,  1977).  The  definition  of  a  team  was 
as  follows: 

The  team  is  usually  well  organized,  highly  structured, 
and  has  relatively  formal  operating  procedures  —  as  exem¬ 
plified  by  a  baseball  team,  an  aircraft  crew,  or  ship 
control  team.  Teams  generally: 

(1)  Are  relatively  rigid  in  a  structure,  organization  and 
communication  networks, 

(2)  Have  well-defined  positions  or  numbers  assignments 
so  that  participation  in  a  given  task  by  each  indi¬ 
vidual  can  be  anticipated  to  a  given  extent, 

(3)  Depend  on  the  cooperative  or  coordinative  participa¬ 
tion  of  several  specialized  individuals  whose  activ¬ 
ities  contain  a  little  overlap  and  who  must  each 
perform  their  task  at  least  at  some  minimum  level  of 
proficiency, 

(4)  Are  often  involved  with  equipment  or  tasks  requiring 
perceptual  motor  activities,  and 

(5)  Can  be  given  specific  guidance  on  job  performance 
based  on  a  task  analysis  of  the  team's  equipment, 
mission  or  situation. 


Task  Nature  of  Member  Roles: 

A  problem  related  to  defining  the  team  is  that  team  composi¬ 
tion  (man  and  machine)  and  member  roles  change  according  to  team 
missions  and  tasks.  An  example  of  this  situation  is  the  TACFIRE 
team  normally  consisting  of  a  Communications  Operator  (Comm.  Op.), 
Fire  Direction  Sergeant  (FDS) ,  and  Fire  Direction  Officer  (FDO) . 

In  many  cases,  external  inputs  should  not  be  considered  as  an 
enlargement  of  team  size,  but  during  a  fire  mission  the  external 
observer  is  as  integrated  into  the  team  operation  as  any  other 
member.  Thus,  while  we  defined  teams  as  having  a  rigid  structure 
with  fixed  organizational  and  communication  networks,  from  a 
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practical  point  of  view,  there  must  be  allowances  for  flexibility 
given  the  variety  of  tasks  performed  by  the  team. 

This  definition  also  allows  for  the  close  analogy  that  can  be 
made  between  team  and  individual  performance.  Skilled  activity  in 
an  individual  means  that  the  individual's  response  meets  certain 
requirements  of  timing,  coordination,  and  sensitivity  to  environ¬ 
mental  changes.  Skilled  activity  by  a  team  means  meeting  the  same 
requirements.  (Glanzer,  1961.)  That  is,  team  skills  can  only  be 
defined  within  the  context  of  the  environment  and  the  mission. 

Thus,  as  these  functions  change,  so  must  the  team  adapt. 

Due  to  this  similarity  between  individual  and  teams,  Glanzer 
further  argued  that  several  general  principles  of  learning  that 
are  applicable  to  individual  training  also  are  applicable  to  team 
training.  These  principles  include: 

Immediate  Feedback  or  Reinforcement.  Knowledge  of  results 
(KOR)  should  be' as  fast  as  possible. 

Simulation.  The  training  situation  should  be  as  similar 
as  possible  to  the  working  environment. 

Representativeness .  The  training  should  sample  the  total 
task  range  of  the  working  environment. 

Statement  and  Incorporation  of  Requirements.  Job  perform¬ 
ance  measures  and  criteria  should  be  explicitly  stated 
and  incorporated  in  the  training  environment. 

Principles  of  Learning.  There  are  a  number  of  learning 
principles  whose  relevance  to  the  training  environment 
should  be  considered.  These  include  the  distribution  and 
massing  of  practice  and  the  use  of  previously  learned 
behavior . 

In  the  analysis  of  teams  for  training  purposes,  it  is  important 
that  the  ISD  designer  not  only  consider  the  structural  definition 
of  the  team  and  the  general  principles  applicable  to  its  training, 
but  also  identify  the  functions  that  are  set  forth  as  the  purpose 
of  team  tasks  and  behavior.  This  analysis  should  lead  to  a  clear 
statement  of  the  team  mission  and  submissions  (specific  jobs  such 
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as  fire  planning,  fire  missions  etc.).  It  is  important  to  struc¬ 
ture  the  jobs  of  the  team  in  order  to  more  precisely  determine  the 
team  organization  and  task  sequences  necessary  to  the  accomplish¬ 
ment  of  the  mission.  Further,  the  ISD  analyst's  primary  responsi¬ 
bility  is  to  relate  team  performance  to  the  fulfillment  of  func¬ 
tional  requirements.  To  improve  team  performance  means  to  more 
efficiently  or  effectively  fulfill  the  functional  requirements. 

Team  Environment: 

Another  important  concept  in  defining  team  training  require¬ 
ments  is  determining  the  operating  situations  in  which  a  team  may 
have  to  perform.  Boguslaw  and  Porter  (1963)  discuss  the  operating 
environment  as  a  continuum,  the  end  points  of  which  are  described 
as  established  or  emergent.  They  define  these  situations  as 
follows • 

An  established  situation  is  one  in  which  (1)  all  action¬ 
relevant  environmental  conditions  are  specifiable  and 
predictable,  (2)  all  action-relevant  states  of  the  sys¬ 
tem  are  specifiable  and  predictable,  and  (3)  available 
research  technology  or  records  are  adequate  to  provide 
statements  about  the  probable  consequences  of  alterna¬ 
tive  actions.  An  emergent  situation  is  one  in  which 
(1)  all  action-relevant  environmental  conditions  have 
not  been  specified,  (2)  the  state  of  the  system  does 
not  correspond  to  relied  upon  predictions,  and  (3)  ana¬ 
lytical  solutions  are  not  available  given  current  states 
of  analytical  technology. 

The  two  conceptual  viewpoints  have  also  served  as  contexts  for 
team  training  research.  For  example,  investigation  of  team  member 
interactions  in  an  established  situation  was  a  primary  focus  of  a 
team  training  laboratory  program  at  the  American  Institute  of 
Research  (Klaus  and  Glaser,  1960) .  There  are  obvious  advantages 
to  the  team  training  laboratory  research,  but  the  often  necessary 
simplification  of  the  team  functions  can  mask  or  omit  possible 
important  variables  which  influence  behavior  in  the  real  world. 
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Abstracting  the  situational  contexts  in  the  laboratory  can  result 
in  a  loss  of  opportunity  for  trainees  to  react  to  breakdowns  or 
problems  which  may  arise  in  an  operational  setting  (Wagner,  et  al., 
1976). 

Providing  skills  to  deal  with  emergent  unstructured  situations 
was  seen  as  a  major  goal  of  a  System  Development  Corporation  team 
training  program  for  the  Air  Force  (Alexander  and  Cooperband,  1965) . 
The  development  of  coordination  skills  was  stressed  although  it 
was  recognized  that  these  are  based  upon  attainment  of  minimum 
individual  skills.  In  turn,  team  training  devices  and  techniques 
were  seen  as  requiring  orientation  for  training  innovative  behaviors 
and  skills  necessary  to  adapt  to  unforeseen  problems.  It  was  agreed 
that  emergent  situation  training  permits  a  more  realistic,  less 
abstract  approach  than  established  situation  training.  In  the  emer¬ 
gent  case,  what  seems  to  be  important  is  training  team  members  to 
become  fully  aware  of  their  responsibilities,  to  compensate  for  the 
inability  of  others,  and  to  overcome  temporary  problems  when  the 
situation  calls  for  it. 

Thurmond  and  Kribs  (1977)  applied  the  concept  of  the  situa¬ 
tional  continuum  to  the  development  of  a  team  job/task  analysis 
technique.  Using  this  technique,  the  standard  operating  proce¬ 
dural  (SOP)  task  flow  was  established  for  a  variety  of  fire  mis¬ 
sion  jobs  performed  by  a  battalion  level  fire  director  control 
team.  Once  the  SOP  flow  was  determined,  the  interviews  were  con¬ 
ducted  with  experienced  team  members  in  order  to  discuss  (1)  the 
emergent  situational  factors  which  impacted  the  SOP,  and  (2)  err¬ 
ors  that  led  to  malfunctions  in  the  team  operations. 

It  is  obvious  that  in  actuality,  no  team  operates  in  purely 
an  established  or  an  emergent  situation.  Therefore,  in  conducting 
the  job/task  and  training  analysis,  emphasis  was  placed  first  on 
defining  the  precise  TACFIRE  established  situation  as  prescribed 
by  standard  operating  procedures  and,  secondly,  on  identifying  the 
most  common  and  critical  emergent  situations  that  impact  actual 
operations  of  the  TACFIRE  system.  By  defining  both  the  established 
and  the  emergent  situations,  the  team  member  interactions  which 
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occur  in  both  cases  could  be  analyzed  in  order  to  determine  the 
team  task  dimensions  that  are  present. 

Implications  for  Collective  Training  ISP; 

Although  the  research  literature  did  not  focus  on  the  problem 
of  designing  and  developing  collective  training,  some  very  clear 
guidelines  emerged.  Those  include: 

1.  Team  behavior  must  be  analyzed  within  the  context  of 
its  purpose  or  mission. 

2.  Individual  job/tasks  performance  requirements  change 
according  to  mission;  therefore,  there  should  be  a 
process  for  identifying  the  specific  individual  job/ 
tasks  associated  with  a  particular  mission. 

3.  Collective  and  individual  performances  occur  along  a 
continuum  of  environmental  conditions  ranging  from 
static  to  highly  dynamic.  Training  should  reflect 
this  range  of  conditions  via  instructional  strategies 
related  to  the  scope  and  sequencing  of  instruction. 

4.  There  are  a  number  of  basic  principles  of  learning 
that  apply  to  both  individual  and  collective  training. 
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APPLICATION  OF  THE  INTERSERVICE  ISD 
PROCEDURES  TO  COLLECTIVE  TRAINING 

This  section  represents  the  results  of  Task  2.  These  results 
were  discussed  in  the  interim  report;  however,  a  review  of  these 
results  is  in  order. 

Each  step  or  function  comprising  the  Analysis,  Design  and  Devel¬ 
opment  phases  of  the  ISD  model,  as  summarized  in  Table  1,  is  dis¬ 
cussed  in  terms  of  (1)  the  adequacy  or  inadequacy  of  the  procedures 
when  applied  to  collective  training,  and  (2)  potential  methods 
that  might  be  more  applicable.  Additionally,  the  model  was  reviewed 
in  order  to  determine  if  the  guidelines  that  emerged  from  the 
research  literature  were  incorporated.  Of  the  14  major  functions, 
seven  were  identified  as  being  both  critical  to  collective  training 
development  and  as  not  being  applicable  in  their  individually- 
oriented  form.  These  included  the  following  functions: 

1.  Analyze  Job 

2.  Construct  Job  Performance  Measures 

3.  Select  Instructional  Setting 

4.  Develop  Objectives 

5.  Develop  Tests 

6 .  Describe  Entry  Behavior 

7.  Determine  Scope  and  Sequence. 

Analyze  Job  —  The  job  analysis  is  the  singularly  most  important 
aspect  of  the  ISD  effort.  From  the  Task  and  Skills  Analysis  (TASA) 
of  the  job  spring  all  other  instructional  design  parameters.  The 
procedures  set  forth  in  TRADOC  PAMPHLET  350-30  provide  considerable 
detail  regarding  job  analysis  procedures  and  outputs.  Task  analy¬ 
sis  worksheets  are  discussed  and  examples  illustrated. 

Task  analysis  has  also  been  identified  as  the  heart  of  team 
training  (Thurmond  and  Kribs,  1977).  However,  the  procedures  and 
worksheets  presented  in  TRADOC  PAMPHLET  350-30  are  not  sufficient 
for  defining  team  operations.  The  team  job/task  analysis  must 
cover  both  standard  operating  procedures  and  emergent  phenomena 
that  impact  the  team's  functioning.  Alexander  and  Cooperband  (1965) 
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saw  the  providing  of  skills  to  deal  with  emergent  instructional 
situations  as  the  most  important  function  of  team  training. 

A  team  job/task  and  training  analysis  was  conducted  for  the 
TACFIRE  battalion  level  Fire  Direction  Control  Team  (Thurmond  and 
Kribs,  1977).  The  methodology  employed  was  a  modification  of  work 
conducted  by  Folley  (1964)  and  Klaus  and  Glaser  (1960) . 

This  analysis  included  a  description  of  each  act  carried  out 
by  team  members  and  the  sequencing  of  the  acts.  Every  act  of 
team  members  was  broken  down  into  three  elements:  input,  the  sig¬ 
nal  or  stimuli  that  elicits  the  behavior;  process ,  the  response; 
and  output,  the  signals  or  stimuli  resulting  from  the  process. 

Each  act  was  then  linked  to  subsequent  acts  as  either  a  man-man 
interaction  or  a  man-computer-man  interaction.  In  this  way  it 
was  possible  to  set  up  a  team  task  flow  for  the  established 
situation . 

The  man-machine-man  interaction  was  representative  of  two 
types  of  machines,  the  radio  and  the  computer,  and  for  two  types 
of  machine  mediation.  The  first  type  of  machine  mediation  requires 
only  that  the  machine  be  a  vehicle  for  transmitting  data  from  one 
point  to  another.  The  radio  always  performs  this  type  of  function, 
the  computer  frequently  does.  The  second  type  of  machine  media¬ 
tion  requires  that  the  machine  perform  a  function  which  before 
its  introduction  was  performed  by  man  or  a  different,  and  probably 
a  less  sophisticated,  machine.  The  function  may  be,  for  example, 
a  calculation,  record  keeping,  a  check  of  procedures,  or  even  the 
making  of  a  decision.  Only  the  computer,  with  its  associated 
peripherals,  can  perform  these  functions.  Thus,  in  the  Job/Task 
Flow  Charts,  the  types  of  system  programs  used  for  data  analysis 
and  manipulation  by  the  computer  are  identified  as  well  as  if  the 
machine  mediation  is  solely  for  the  data  transmittal. 

Figure  1  illustrates  the  team  task  flow  for  a  segment  of  a 
fire  mission  conducted  by  the  FDC  team  in  an  automated  mode.  As 
can  be  seen,  the  approach  combines  traditional  task  analysis  tech¬ 
niques  with  the  operations  research  technique  of  developing  opera¬ 
tional  sequence  diagrams  (OSD)  in  defining  the  standard  operating 
procedure  for  a  particular  team  mission. 
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Figure  1  Excerpt  from  Job/Task  Flow  Chart  of  Fire  Mission 

Processed  in  Automatic  Mode. 
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The  second  phase  of  the  team  job/task  analysis  was  to  identify 
emergent  situations  at  each  point  of  team  member  action  and  inter¬ 
action.  Emergent  factors  included  (1)  individual  errors  (both 
errors  of  commission  and  omission  were  identified,  (2)  machine 
failures,  and  (3)  contingent  environmental  conditions  (ranging 
upwards  to  catastrophes) .  Individual  errors  were  further  analyzed 
to  determine  the  impact  on  the  total  team  operation  and  to  deter¬ 
mine  how  they  could  be  mitigated  via  team  training. 

Construct  Job  Performance  Measures  —  Job  Performance  Measures  (JPM) 
are  constructed  for  each  task  identified  during  the  job/task  and 
training  analyses.  The  JPM  is  a  precise,  quantitatively-based 
statement  of  what  is  expected  in  job  performance  and  how  best  to 
measure  an  individual  realization  of  that  performance.  In  many 
cases,  the  JPM  will  in  fact  be  performance  of  the  task.  In  other 
cases,  where  time,  costs,  safety  and  other  such  factors  mitigate, 
the  actual  task  cannot  be  performed.  In  such  instances,  the  ISD 
designer  must  develop  test  conditions  and  standards,  the  results 
from  which  will  predict  job  performance.  In  the  latter  case,  con¬ 
sideration  must  be  given  to  the  need  for  simulators  or  other  fac¬ 
tors  which  may  effect  the  level  of  fidelity  built  into  the  JPM. 

A  high  fidelity  JPM  is  one  that  closely  resembles  the  actions,  con¬ 
ditions,  cues,  and  standards  actually  performed  on  the  job. 

The  guidelines  for  developing  JPMs  for  individually  oriented 
tasks  are  complete;  however,  no  techniques  for  establishing  team 
and  team  member  performance  measures  have  been  developed.  Further 
research  is  required  in  the  area  of  developing  procedures  for 
systematically  identifying  and  structuring  JPMs  as  well  as  mathe¬ 
matically  determining  values  for  the  standards. 

Select  Instructional  Setting  —  TRADOC  PAMPHLET  350-30  identifies 
five  instructional  settings  to  which  tasks  can  be  assigned: 

1.  Job  Performance  Aids  (JPAs) .  (Even  though  a  job  per¬ 
formance  aid  is  not  technically  instruction,  it  can 
serve  to  eliminate  the  need  for  training.) 

2.  Self-Teaching  Exportable  Packages  (STEPs) 
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3.  Formal  On-The-Job  Training 

4.  Installation  Support  Schools  (ISS) 

5.  Resident  Schools  (RS) 

There  are  guidelines  for  assigning  tasks  to  specific  settings 
and  for  conducting  trade-offs  based  on  requirements  and  resources. 

The  guidelines  for  individual  training  are  not  applicable  to 
team  training.  The  major  reasons  for  this  are  individual  aids 
such  as  JPAs  and  STEPS  are  inherently  inadequate  except  for  teach¬ 
ing  individual  team  members  skills  since  they  are  not  designed  to 
account  for  interactive  tasks.  The  decision  as  to  whether  or  not 
team  training  should  be  conducted  in  resident  schools  or  at  unit 
sites  must  be  based  on  a  different  set  of  criteria.  The  major  con¬ 
sideration  for  determining  the  site  of  team  training  includes 
facilities,  impact  on  jobs,  availability  of  personnel  (supervisory 
and  trainees) ,  and  availability  of  equipment.  This  decision  process 
can  be  modeled  with  explicit  criteria  established  for  each  decision 
point.  The  trade-offs  that  may  be  made  regarding  site  selection 
depend  on  cost  benefits  analysis. 

Develop  Objectives  —  The  development  of  learning  objectives  for  indi 
vidual  training  follows  standard  procedu-res.  Objectives  are  written 
for  each  training  task  selected,  and  each  terminal  objective  must 
specify  actions,  conditions,  and  standards.  The  training  tasks  and 
objectives  are  classified  by  the  following  four  categories: 

a.  Information 

b.  Mental  skills 

c.  Physical  skills 

d.  Attitudes 

There  is  no  reason  that  the  procedures  for  developing  team  learn 
ing  objectives  should  differ  greatly  for  those  set  forth  in  TRADOC 
PAMPHLET  350-30.  However,  Thurmond  and  Kribs  (1977)  state  that  the 
procedures  for  developing  the  team  objectives  were  inadequate. 

There  are  two  major  problems  encountered.  First,  the  inputs  to 
this  step  were  inadequate.  If  each  step  of  the  model  had  been 
applicable,  then  the  data  base  for  the  objective  development  would 


have  been  complete.  Second,  there  is  a  need  to  develop  new  cate¬ 
gories  for  objectives.  Foremost  is  the  need  for  a  communications 
category  and  guidelines  for  addressing  knowledge  of  team  roles  and 
attitudes  under  existing  categories. 

Develop  Test  —  Good  test  construction  depends  on  a  good  data  base 
as  well  as  good  techniques  for  item  development.  Both  of  these 
dimensions  are  addressed  in  the  individual  ISD  model.  Tests  must 
accurately  represent  job  performance  measures  and  be  constructed 
to  meet  the  criteria  established  in  learning  and  terminal  objectives. 
In  regard  to  team  training,  the  prior  sections  point  out  the  defi¬ 
ciencies  in  generating  useful  JPMs  and  objectives.  Given  that  a 
team  ISD  model  will  contain  procedures  for  developing  good  JPMs 
and  objectives,  there  remains  a  need  for  guidelines  for  test  devel¬ 
opment.  There  has  been  little  research  in  the  area  of  team  assess¬ 
ment  instruments  and  the  variables  measured  therein.  However,  the 
development  of  the  National  Training  Center  should  provide  consid¬ 
erable  advancement  in  team  performance  evaluation  techniques. 

Describe  Entry  Behavior  -  In  TRADOC  PAMPHLET  350-30,  two  principal 
classes  of  entry  behaviors  are  identified: 

1.  Basic  aptitude  and  ability,  and 

2.  Acquired  knowledge  and  skills. 

It  is  recognized  that  very  little  can  be  done  to  change  the 
basic  aptitudes  and  ability  of  the  entering  trainee  and  therefore 
instructional  material  characteristics  such  as  readability,  formats, 
and  comprehensibility  must  match  up  with  the  trainee  profile.  On 
the  other  hand,  trainees'  acquisition  of  knowledge  and  skills  not 
only  will  vary,  similarly  to  their  basic  aptitudes  and  abilities, 
but  it  will  be  dynamic,  based  on  student  capability  and  motivation. 

Entry  behavior  descriptions  are  developed  from  two  principal 
sources : 

1.  Administrative  data 


2. 


Testing 


Team  entry  behavior  descriptions  should  come  from  the  same 
sources.  Administrative  data  would  provide  a  profile  of  individual 
team  members,  and  it  could  be  used  to  generate  a  team  profile.  The 
dimensions  of  the  latter  have  not  been  defined,  but  consideration 
should  be  given  to  the  time  the  team  has  worked  together,  prior 
operational  experience,  unit  performance  records,  etc. 

Testing  should  also  be  a  primary  source  of  the  team  entry 
behavior  description.  Both  entry  and  pretest  are  desirable,  but 
the  entry  test  serving  as  a  diagnostic  is  most  important.  A  diag¬ 
nostic  entry  test  would  provide  information  regarding  the  team's 
weaknesses  in  terms  of  specific  tactical  operations  and  the  level 
of  training  where  the  team  should  begin.  The  diagnostic  entry 
test  procedure  will  be  closely  tied  to  the  test  construction  pro¬ 
cedures  developed  for  the  previous  step. 

Determine  Scope  and  Sequence  —  The  ISD  process  for  determining 
instructional  scope  and  sequence  involves  conducting  a  learning 
analysis  and  identifying  relationships  that  exist  between  or  among 
objectives.  In  team  training,  the  scenario  format  precludes  the 
presentations  of  a  precise  objectives  hierarchy  based  upon  charac¬ 
teristics  and  relationships  of  tasks. 

However,  in  order  to  match  the  entry  level  and  projected  accum¬ 
ulative  learning  of  the  subjects  with  the  variety  of  team  inter¬ 
actions  present  in  a  continuum  of  tactical  combat  situations,  it 
is  necessary  to  develop  a  scope  and  sequence  of  scenario  presen¬ 
tations.  In  essence,  team  training  occurs  at  four  levels.  These 
levels  are  (1)  individual  training,  (2)  beginning  team  training, 

(3)  integrated  team  training,  and  (4)  emergent  team  training.  The 
scope  and  sequence  must  reflect  both  the  theoretical  underpinning 
as  well  as  the  implementation  of  our  team  ISD  model.  Thus,  each 
scenario  within  the  training  progression  incorporates  increasing 
complexity  in  regard  to  team  member  roles;  information  flows, 
decision  and  problem  solving  requirements;  coordination  activi¬ 
ties;  and  tactical  evolutions  develop.  The  following  paragraphs 
discuss  each  level  of  the  scenario  presentation; 
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Individual  Training: 

As  stated  in  the  above  paragraph,  it  is  assumed  that  a  minimum 
level  of  individual  competence  must  be  achieved  before  team  train¬ 
ing  can  be  effective  and  efficient.  The  interservice  ISD  Model 
provides  the  methods  for  developing  the  individual  training. 

Beginning  Team  Training; 

The  second  sequence  of  scenarios  should  be  in  the  beginning 
team  lesson.  This  type  of  lesson  should  introduce  the  subjects,  for 
the  first  time,  to  coordinated  sequence  drills.  In  addition,  prob¬ 
lem  complexity  should  be  increased  by  number  of  missions,  amount 
and  complexity  of  tactical  information  and  amount  and  complexity 
of  team  problem  solving  activities.  The  beginning  team  training 
essentially  is  doctrine  training,  focusing  on  the  established  team 
roles . 

Integrated  Team  Training; 

The  third  level  of  scenarios  should  represent  integrated  team 
training.  Integrated  team  training  is  designed  to  incorporate 
instructional  strategies  which  are  related  to  coordination  and  com¬ 
pensatory  member's  interactions.  The  team  members  should  be  pre¬ 
sented  with  multiple  tasks  which  are  to  be  integrated  through 
specific  decision  processing  regarding  the  allocation  of  team 
resources.  This  instructional  sequence  should' represent  the  multi¬ 
ple  mission  and  task  operations  which  characterize  actual  operations. 
Thus,  the  team  will  have  to  demonstrate  both  individual  and  team 
coordinated  (compensatory)  behaviors  through  the  lesson.  The  de¬ 
cision  base  should  be  dynamic,  primarily  based  on  individual  per¬ 
formances  and  mission-task  priorities.  The  operational  conditions 
for  the  integrated  team  training  scenario  (e.g.,  equipment,  per¬ 
sonnel,  logistics,  etc.)  should  be  presented  in  a  favorable  tacti¬ 
cal  evolution. 
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Emergent  Team  Training; 

The  final  sequence  of  scenarios  is  for  emergent  team  training. 
These  scenarios  should  be  designed  to  incorporate  all  instructional 
strategies  previously  employed  —  specifically  emphasizing  those  of 
major  complexity  within  the  integrated  team  training  scenarios. 
Further,  the  instruction  should  incorporate  operational  fluctua¬ 
tions  (positive  and  negative)  and  operation  catastrophes  as  identi¬ 
fied  in  the  job/task  flow  charts. 

Specify  Learning  Events/Activities  —  TRADOC  PAMPHLET  350-30  does  not 
use  the  term  "instructional  strategies".  However,  this  step  involves 
activities  that  underlie  the  selection  of  an  instructional  strategy 
for  individual  training.  The  procedures  consist  of  applying  an  algo¬ 
rithm  for  classifying  learning  objectives.  The  classifications  of 
the  learning  to  take  place  are  associated  with  detailed  learning 
guidelines.  The  guidelines  are  applicable  to  the  teaching  of  indi¬ 
vidual  team  member  skills  and  provide  insight  into  specifying  the 
use  of  knowledge  of  results,  performance  monitoring,  and  identify¬ 
ing  key  instructional  decision  points. 

Team  training  instructional  strategies  have  been  defined  simi¬ 
larly  to  individual  strategies  (Thurmond  and  Kribs,  1977;  Hansen, 
1970)  .  By  definition,  instructional  strategies  are  the  product  of 
a  series  of  decisions  which  provide  for  structuring  the  training  by 
such  variables  as  media  choice,  content,  pacing,  level  of  difficulty, 
reading  level,  feedback,  etc.  These  decisions  are  based  upon  three 
types  of  information;  (1)  the  task  to  be  learned,  (2)  the  learner, 
and  (3)  the  delivery  system  for  instruction.  As  yet,  there  are  no 
guidelines  for  integrating  this  information  and  making  the  required 
decisions.  Sets  of  general  learning  guidelines  could  be  developed. 
The  basis  for  the  guidelines  should  be  the  team  task  dimensions, 
the  framework  for  determining  instructional  scope  and  sequence, 
and  the  existing  interservice  procedures  for  individual  training. 

Summary 

The  interservice  procedures  for  instructional  system  develop¬ 
ment  presented  in  TRADOC  PAMPHLET  350-30  provides  a  well  organized 
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framework  for  developing  team  ISD  procedures.  However,  they  are 
clearly  insufficient  without  content  modifications  and  enhancements 
to  serve  as  the  guidelines  to  team  training  materials  development. 
The  area  where  considerably  more  proceduralization  is  required  is 
in  the  analysis  phase.  Team  job/task  analysis  techniques  must  be 
developed.  These  techniques  should  yield  task  analytic  data  that 
represents  team  operations  in  standard  operating  situations  and 
in  emergent  situations  where  task  and  environmental  factors  are 
unpredictable.  Other  steps  that  are  deficient  include  the  devel¬ 
opment  of  team  job  performance  measures  and  the  selection  of  the 
instructional  setting.  In  both  of  these  cases,  existing  procedures 
provide  groundwork  and  a  beginning  point. 

Another  basis  for  developing  a  team  ISD  model  is  the  findings 
of  the  extensive  amount  of  research  conducted  on  teams  and  team 
training.  This  data  base  has  served  as  the  primary  underpinning 
of  this  study.  Conceptual  and  empirical  views  of  team  operations 
and  training  will  serve  well  as  the  framework  for  a  team  ISD  model. 

RELATIONSHIP  OF  SKILL  &  PERFORMANCE  AIDS  (SPA) 

TO  COLLECTIVE  TRAINING 

This  section  summarizes  the  approach  that  the  Army  has  devel¬ 
oped  so  that  training  and  technical  documentation  will  be  integrated 
and,  hopefully,  contribute  to  a  more  effective  training  program 
and  an  improved  operational  readiness  state  for  soldiers  and  equip¬ 
ment.  .  The  thrust  of  the  approach  is  to  provide  more  usable  and 
comprehensible  technical  manuals  and  to  provide  training  that  is 
job  oriented.  Thus,  there  is  an  emphasis  on  Extension  Training 
Materials  (ETMs)  as  well  as  school  curricula. 

A  fundamental  premise  of  the  SPA  approach  is  that  the  U.S. 

Army  Training  and  Doctrine  Command  (TRADOC)  will  be  a  full  partner 
in  the  acquisition  of  technical  documentation.  TRADOC  assumes 
specific  responsibility  throughout  the  life  cycle  of  an  acquisi¬ 
tion,  ensuring  that  training  considerations  addressed  in  conjunc¬ 
tion  with  the  specification  and  development  of  other  technical 
documentation.  In  the  following  subsections  these  responsibili¬ 
ties  shall  be  discussed  as  they  relate  or  may  have  a  potential  for 
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relating  to  collective  training.  Further,  the  developmental  pro¬ 
cesses  associated  with  TRADOC 1 s  training  responsibilities  shall  be 
reviewed  for  their  application  to  collective  training.  The  major 
source  documents  for  this  section  are: 

•  "DARCOM/TRADOC  Policy  Statement  of  Integrated  Technical 
Documentation  and  Training  ( ITDT) ,  "Department  of  the 
Army  Headquarters,  TRADOC,  Fort  Monroe,  VA  23651,  31 
January  1978. 

•  Integrated  Technical  Documentation  and  Training  Prepara¬ 
tion  Guide,  U.S.  Army  Communications  Research  and  Devel¬ 
opment  Command  (CORADCOM) ,  June  1978. 

•  Technical  Documentation  and  Training  Acquisition  Hand¬ 
book,  U.S.  Army  DARCOM/TRADOC  2  May  1977  (Draft). 

DARCOM  Cl  AMCP  750-16,  DARCOM  Guide  to  Logistic  Support 
Analysis ,  "Appendix  G:  Development  of  Integrated  Techni¬ 
cal  Documentation  and  Training  Materials  Utilizing 
Logistic  Support  Analysis,"  U.S.  Army  DARCOM  Materiel 
Readiness  Support  Activity,  Lexington,  Kentucky,  January 
1978  (Draft) . 

Additionally,  considerable  information  was  obtained  from  Ken¬ 
neth  A.  Polcyn's  report:  "U.S.  Navy:  Training  Relationships,  Respon¬ 
sibilities,  and  Problems  and  the  Possible  Implications  for  the  Naval 
Technical  Information  Presentation  System  (NTIPS)  Training  Interface." 

Training  Responsibilities  in  the  SPA  Life  Cycle 
Management  Model  (LCSMM) 

As  a  point  of  reference,  it  should  be  noted  that  TRADOC  does 
not  have  the  sole  responsibility  for  the  funding  of  training  mater¬ 
ials.  The  funding  responsibilities  for  SPA  are  delineated  for  both 
new  and  fielded  systems.  In  the  former  case,  DARCOM  has  the  sole 
responsibility  for  new  system  funding  to  include  front  end  analy¬ 
sis,  technical  documentation,  and  training  materials  required  by 
New  Equipment  Training  (NET)  teams  to  introduce  a  system  into  oper¬ 
ational  units  and  TRADOC  schools.  TRADOC  is  to  provide  for  any 
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additional  training  materials.  Both  DARCOM  and  TRADOC  provide 
funds  for  the  procurement  of  SPA  for  fielded  systems  or  items. 

What  is  relevant  to  this  report  is  that  there  is  a  close, 
working  interface  between  the  Army  Training  and  Materials  Command 
and  that  specific  training  activities  have  been  related  to  LCSMM 
basic  events.  A  summary  of  that  relationship: 

Concept  Generation  —  In  regard  to  the  concept  generation  phase,  if 
SPA  is  to  be  applied,  the  responsibility  for  executing  front-end 
training  studies,  etc.,  belongs  to  TRADOC.  Therefore,  from  the 
beginning  of  the  acquisition  process  the  appropriate  TRADOC  school 
is  directly  involved.  The  specific  responsibilities  of  TRADOC 
during  this  phase  include: 

•  Determining  an  individual’s  role  in  the  proposed  system 
and  identifying  associated  implications  for  training, 

•  Developing  a  training  concept  indicating,  in  general, 
when,  where,  and  how  training  can  be  best  accomplished, 

•  Identifying  and  specifying  studies  needed  to  validate  the 
training  concept, 

•  Developing  an  outline  Individual/Collective  Training 
Plan  (ICTP)  summarizing  the  training  concept  and  asso¬ 
ciated  strategies  and  development  plan,  and 

•  Preparing  and  providing  inputs  to  the  basic  systems  analy¬ 
sis,  documentation  and  decision-making  events,  such  as 
the  Letter  of  Agreement  (LOA) ,  Concept  Formulation  Pack¬ 
age  (CFP) ,  Outline  Development  Plan  (ODP)  and  program 
initiation  decision  process. 

Validation  —  During  the  validation  phase  TRADOC  is  responsible  for 
six  activities.  Some  are  contracted  while  others  are  executed 
directly  by  TRADOC  or  in  conjunction  with  DARCOM.  The  training- 
related  activities  include: 
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•  Preparing  the  Technical  Data  Package  to  be  used  in  solic¬ 
iting,  identifying,  and  selecting  the  appropriate  con¬ 
tractor  (s)  for  the  conduct  of  the  front-end  analysis, 

•  Conducting  the  front-end  analysis, 

•  Evaluating  alternative  training  program  designs, 

•  Specifying  training  device  requirements, 

•  Preparing  a  detailed  training  plan,  and 

•  Providing  input  and  support  to  basic  system  events  as 
required,  which  includes  the  planning  and  conduct  of  Devel¬ 
opment  Testing  (DT) /Operational  Testing  (OT)  I;  prepara¬ 
tion  of  the  Required  Operational  Capability  (ROC)  or 
Letter  Requirements  (LRs) ;  and  preparation  of  the  Devel¬ 
opment  Plan  (DP) . 

Engineering  Development  —  The  primary  training  activities  during 
this  phase  are  developing  training  program  materials  in  keeping 
with  the  approved  design  and  validating  the  instructional  program. 
The  major  TRADOC  functions  are  monitoring  and  reviewing  intermediate 
and  final  products  and  coordinating  interfaces.  Major  activities 
include: 

•  Awarding  the  Training  Development/Production  contract 

•  Developing  materials  and  devices 

•  Commencing  NET 

•  Validating  the  program 

•  Providing  input  to  the  LCSMM  basic  events  —  the  engineer¬ 
ing  development  contract,  the  planning  and  conducting  of 
DT/OT  II,  the  DP  update,  and  the  production  and  deploy¬ 
ment  decisions. 

Input  to  the  DT/OT  III  includes  training  test  participants 
with  the  training  package  and  evaluating  the  results,  using  data 
from  training  activities  to  update  the  DP,  and  using  data  from 
cost-effectiveness  studies  and  the  other  data  points  to  derive 
system  production/deployment  decisions. 
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The  Army  also  addresses  the  phase-out  of  the  program  and  re¬ 
sponsibilities  of  TRADOC  throughout  the  deployed  life  of  a  system 
or  item  and  throughout  the  life  cycle  of  the  training  acquisition 
process.  TRADOC  is  supposed  to  keep  a  systematic  record  of  activ¬ 
ities  and  costs  for  reference  in  future  acquisition  efforts. 
Emphasis  is  on  summation  of  job  and  task  performance  requirements, 
data  collection  and  analysis  methods,  training  methods  and  media, 
cost-effectiveness  information,  and  chronology  of  lessons  learned. 
During  program  phase-out,  TRADOC  is  supposed  to  update  the  data 
and  assemble  and  store  it  in  a  central  location  for  convenient 
reference . 

Table  2  provides  a  summary  of  the  relationship  of  training 
activities  to  basic  events  of  the  acquisition  process. 

In  summary,  these  are  the  major  TRADOC/DARCOM  acquisition 
process  interfaces  that  have  been  spelled  out  by  the  Army  to  ensure 
that  SPA  works.  In  addition  to  providing  information  on  what  needs 
to  be  done,  the  Army  gives  direction  as  to  how  the  work  can  be 
accomplished . 

A  Summary  of  the  Integrated  Technical  Documentation 
and  Training  Development  Process 

As  illustrated  in  Figure  2,  the  SPA  approach  consists  of  five 
components  which  are  embedded  in  the  U.S.  Army  LCSMM.  The  first  is 
deciding,  during  the  Requirement  Concept  Phase,  whether  to  apply 
the  approach;  if  the  decision  is  yes,  then  a  Front  End  Analysis 
(FEA)  is  conducted  during  the  Validation  Phase.  During  the  next 
phase,  Full-Scale  Engineering  Development  (FSED) ,  the  concurrent 
and  interrelated  development  of  TMs  and  Training  materials  occurs. 
The  next  step,  verification,  is  initiated  during  the  Engineering 
Development  Phase  and  may  or  may  not  be  concluded  during  the  Pro¬ 
duction  and  Deployment  Phase.  It  is  in  this  phase  that  TM  and 
Training  materials  are  distributed.  The  FEA,  TM  and  Training 
materials  development  processes  are  primarily  the  responsibility 
of  a  contractor,  while  the  verification  and  acceptance  functions 
are  the ' responsibility  of  the  U.S.  Army.  What  is  most  important 
to  this  study  is  the  process  for  conducting  the  FEA.  However, 


REQUIREMENTS  VALIDATION  FULL  SCALE  ENGINEERING  DEVELOPMENT  PRODUCTION  &  DEPLOYMENT 


SPA  GENERAL  DEVELOPMENT  PROCESS 


EVENT* 

LCSMM  PHASES  AND  BASIC  EVENTS 

■ 

ASSOCIATED  TRAINING  ACTIVITIES 

RQ'MT  CONCEPT  GENERATION 

t 

-  Materiel  Concept  Investigation 

e  Materiel/Training  Trade-off  Analysis 

2 

LOA 

e  Establish  Training  Concept 

8 

CFP 

e  Identify  Study  Needs 

9 

OOP 

a  Prepare  Outline  Training  Plan 

14 

Program  Initiation  Decision 

a  Inputs  to  LCSMM  (LOA.  CFP,  etc.) 

VALIDATION  PHASE 

16 

Advanced  Development  Contract 

e  Front-end  Analysis  and  Design  Contract 

21-22 

DT/OT  1 

•  Perform  Front-end  Analysis 

31 

ROC/LR 

e  Evaluate  Alternative  Designs 

33 

OP 

e  Specify  T raining  Device  Requirements  (TDR) 

37/42 

Full-scale  Development  Decision 

a  Prepare  Training  Plan 

t  Inputs  to  LCSMM  (ROC/LR.  DP.  etc.) 

FULL-SCALE  ENG'R  DEVELOPMENT  PHASE 

45 

Engineering  Development  Contract 

e  Training  Development/Production  Contract 

51-52 

DT/OT  II 

e  Develop  Materials/Devices 

60 

Update  DP 

e  Start  New  Equipment  Training 

64/71 

Prod,  and  Deployment  Oecision 

•  Validate  Program  (OT  II) 

e  Inputs  to  LCSMM  Basic  Events 

PRODUCTION  ANO  DEPLOYMENT  PHASE 

72 

Production  Contract 

e  Produce  Training  Materials/Devices 

78-79 

DT/OT  III  (If  Authorized) 

e  Field  Test  Program 

82 

Update  DP 

•  Update  Training  Plan 

105 

IOC 

111 

Materiel  Objective  Achieved 

a  Implement  Program  (Resident  and  Unit) 

117 

Reqt.  for  New  Materiel  Identified 

e  Evaluate/Revise  Program 

118 

Type  Class  Contingency 

a  Inputs  to  LCSMM  Basie  Events 

119 

Type  Class  Obsolete/Disposal 

a  Phase-out 

SOURCE 

Technical  Documentation  and 

Training  Acquisition  Hand- 

book.  U.S.  Army  DARCOM/TRADOC  2  May  1977  (Draft) 
Table  3-1,  p.  3-14. 


I 

I 


32 


before  discussing  the  FEA,  a  brief  summary  of  each  of  the  steps 
in  the  developmental  process  is  presented. 

SPA  Approach  Decision  —  The  criteria  which  are  used  to  determine 
whether  the  SPA  will  be  used  are  listed  following: 

•  Combat  criticality 

•  Density 

•  Size  of  MOS  population 

•  Training  costs 

•  Commonality 

•  Foreign  military  sales  potential 

•  Stage  of  life  cycle 

•  Availability  of  funding  to  support  program 

•  Delay  caused  to  testing  or  field  system. 

If  an  item  is  highly  critical  for  combat,  its  readiness  to 
perform  should  be  ensured  through  SPA.  If  it  has  a  high  density, 
requires  a  large  number  of  people  who  would  normally  receive  exten¬ 
sive  school  training,  or  is  common  to  several  systems,  it  is  a 
prime  candidate  for  the  overall  life  cycle  cost  savings  inherent 
in  SPA.  A  high  foreign  military  sales  potential  also  increases 
the  appropriateness  of  the  item  for  SPA.  The  last  three  criteria 
may  weigh  against  the  approach.  If  an  item  is  in  an  advanced 
stage  of  the  life  cycle,  the  cost  of  replacing  existing  technical 
documentation  and  training  materials  may  outweigh  the  benefits  of 
SPA  coverage.  Similarly,  the  limited  availability  of  funds  for 
low  priority  items  may  preclude  their  conversion  to  the  approach. 
Moreover,  the  approach  may  be  excluded  if  it  would  delay  the 
fielding  of  a  critical  item. 

Front-End  Analysis  —  The  FEA  is  based  on  a  thorough  LSA:  these 
analyses  may  or  may  not  be  conducted  by  a  contractor.  The  FEA 
has  three  stages: 

•  An  equipment  analysis  to  identify  equipment  tasks, 
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•  A  functional  analysis  to  locate  fault  symptoms  requiring 
troubleshooting  and  to  describe  mission  functions  and 
the  operation  of  related  equipment  systems,  and 

•  A  task  analysis  to  derive  data  to  be  used  in  technical 
documentation  and  training  material  development. 

If  under  contract,  each  of  the  three  products  is  reviewed  and 
approved  by  DARCOM  and  TRADOC  representatives  before  the  contractor 
is  permitted  to  proceed.  These  products  are  then  used  to  create 
the  technical  documentation  and  training  materials. 

Technical  Documentation  Development  —  The  Technical  Documentation 
(TM)  development  is  comprised  of  two  separate  sets  of  tasks. 

These  are: 

•  A  Behavior  Task  Analysis  (BTA)  which  is  conducted  to 
correlate  the  behavioral  objectives  of  each  subtask 
with  the  cues  that  guide  the  associated  response. 

•  The  development  of  TMs  which  contain  task  performance 
sequences  with  detailed,  illustrated  step-by-step  per¬ 
formance  instructions. 

Training  Materials  Development  —  The  requirement  that  a  concurrent 
and  integrated  development  of  training  materials  and  TMs  be  exe¬ 
cuted  dictates  an  internal  contractor  development  relationship 
between  TM  and  training  personnel  that  has  not  been  the  norm  in 
the  past. 

The  training  materials  that  can  be  developed  under  the  SPA 
approach  cover  the  known  spectrum;  they  include  printed,  audio¬ 
visual  and  computer-based  material.  Basic  training  materials, 
which  are  developed  to  support  courses  for  a  specific  job  duty 
position,  include  lesson  materials  and  instructions,  tests  and 
training  guides.  Among  the  materials  are: 

•  Administrative  instructions  for  training  managers,  cri¬ 
terion  referenced  pre-  and  post-lesson  and  module  tests, 
and  so  on.  The  instruction  sheets  reference  applicable 
TMs  containing  the  content  for  training. 


•  Student  Guides  (SG)  designed  to  enable  trainees  to  plan 
and  manage  their  own  training. 

•  Training  Management  Guides  (TMG)  designed  to  enable  the 
training  manager  or  supervisor  to  administer  using  the 
ETM  course  materials. 

Throughout  the  development  of  the  materials,  they  are  checked 
by  Training  personnel  and  reviewed  to  ensure  compatibility  with 
the  TMs. 

Training  Materials  and  TM  Verification  —  An  important  aspect  of  the 
SPA  concept  is  that  only  a  minimal  number  of  training  materials  are 
prepared  since  TMs  provide  the  major  means  for  conveying  procedures 
and  related  information  for  task  performance;  training  materials 
are  used  as  a  supplement  to  TMs  to  teach  the  operation  and  mainte¬ 
nance  of  specified  Army  systems. 

Verification  of  the  total  package  involves  validation  of  indi¬ 
vidual  TM  and  training  material  products,  or  portions  of  products, 
by  testing  them  on  a  sample  of  personnel  representative  of  the 
target  group.  The  real  proof  of  usability  and/or  effectiveness 
for  SPA  materials  is  demonstrating  that  Army  units  can  utilize  new 
or  unfamiliar  equipment  guided  only  by  SPA  documentation.  Prior  to 
delivery,  the  complete  set  of  materials  is  verified,  through  test¬ 
ing  by  the  government  or  contractor,  and  revised  as  needed.  The 
final  product  is  an  integrated  technical  documentation  and  train¬ 
ing  package. 

TM  and  Training  Materials'  Distribution,  Update,  and  Revision  —  The 
TMs  are  reproduced  and  distributed  through  the  Army  Technical  Pub¬ 
lication  Facilities,  whereas  the  training  materials  are  reproduced 
and  distributed  through  the  Training  Extension  Course  (TEC)  Pro¬ 
gram  Facilities.  Therefore,  close  coordination  is  required  between 
the  two  for  detecting  deficiencies,  providing  for  corrections,  and 
incorporating  updates  and  modified  information. 

Key  SPA  Guiding  and  Procedural  Specifications , 

Standards,  Directives,  and  Products 

The  development  of  the  SPA  approach  was  built  upon  existing 
DoD  Directives  and  Military  Standards.  New  guiding  documentation 
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was  developed  only  when  necessary,  but  such  documentation  primarily 
deals  with  how  to  structure  data  normally  collected  during  an  LSA 
to  meet  the  SPA  objectives.  Consequently,  new  guiding  documenta¬ 
tion  has  been  held  to  a  minimum.  The  key  to  the  concept  is  the 
initial  and  continuing  ILS  data  generation  and  collection  effort. 

Existing  Documentation  —  The  primary  document  upon  which  SPA  is 
built  is  Military  Standard  Logistic  Support  Analysis  1388-1  (MIL- 
STD-1388-1) ,  which  establishes  criteria  governing  performance  of 
an  LSA.  The  LSA  flow  and  LSA  requirement  data  identified  in  MIL- 
STD-1388  are  used  as  a  baseline  and  expanded  so  that  SPA  analyses, 
etc.,  can  be  conducted  and  the  data  structured  for  the  ultimate 
development  of  integrated  technical  documentation  and  training 
materials . 

Of  the  thirteen  LSA  tasks  identified  in  MIL-STD-1388 ,  the 
major  contributors  to  technical  documentation  and  training  data 
requirements  are  the  logistics  requirements  identification  and 
engineering  interfacing  tasks.  Logistic  requirements  identifica¬ 
tion  tasks  define  the  requirements  of  the  principal  elements  of 
ILS.  These  are  shown  in  Figure  3.  Engineering  interfacing  plays 
an  important  role  in  that  it  supplies  basic  logistic  data  from 
the  following  engineering  specialty  areas  and  programs: 

•  System  and  Design  Engineering 

•  Reliability  Program  (MIL-STD-785) 

•  Maintainability  Program  (MIL-STD-470) 

•  Human  Engineering  Program  (MIL-H-46855) 

•  Standardization  Program  (Mil-STD-680) 

•  Safety  Program  (MIL-STD-882 ) 

•  Packing,  Handling,  Storage,  and  Transportability 
Program  (MIL-STD-1367) . 

These,  then,  are  the  key  components  of  the  TI  generation  and 
data  processing  system  upon  which  SPA  is  based. 


REQUIREMENTS  DATA 


New  Documentation  —  Building  on  the  above  data  base,  the  Army  devel¬ 
oped  documentation  which  would  permit  an  interface  with  LSA  and 
the  structuring  of  LSA  data  to  meet  the  SPA  objectives.  There  are 
seven  such  documents,  six  of  which  emphasize  TM  development, 
since  TMs  are  the  heart  of  the  SPA  concept.  The  SPA  documentation 
includes : 

•  MIL-M-63035  (TM)  Technical  Manual  Front  End  Analysis  — 
Details  the  requirements  and  procedures  for  performing  a 
system-specific  job  analysis  prior  to  the  development  of 

*  TMs  and  training  materials.  It  is  the  key  SPA  specifi¬ 

cation. 

•  MIL-M-63036  (TM)  Preparation  of  Operator's  Technical 
Manuals  —  Provides  the  detailed  requirements  for  the 
preparation  of  Operator's  TMs  for  all  equipment  except 
aircraft.  This  is  also  a  basic  SPA  specif ication  required 
of  all  projects. 

There  are  three  specifications  which  treat  the  development  of 
maintenance  TMs  MIL-M-63037,  MIL-M-63038  and  MIL-M-63039. 

•  MIL-M-63037  (TM)  Organization,  Direct  Support  and  General 
Support  Maintenance  Technical  Manual  —  Specifies  and  de¬ 
tails  the  use  of  flow  charts  for  presenting  maintenance 
information;  e.g.,  troubleshooting  procedures  to  be  in 
the  form  of  symptom-oriented  branching  and  illustrated 
logic  tree  flow  charts. 

•  MIL-M-63038  (TM)  Organization,  Direct  Support  and  General 
Support  Maintenance  Technical  Manual  —  Provides  technical 
content  and  arrangement  requirements  for  maintenance  TMs. 
Associated  style  and  format  requirements  and  TM  writing 
information  are  provided  in  two  companion  publications: 

•  MIL-HDBK-63038-1  (Technical  Manual  Writing  Handbook)  and 

•  MIL-HDBK-63038-2  (Technical  Writing  Style  Guide) . 

•  MIL-M-63039  (TM)  Organization,  Direct  Support  and  General 
Support  Maintenance  Technical  Manual  -  Provides  detailed 
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requirements  for  the  preparation  of  maintenance  TMs  in  a 
Job  Performance  Manual  (JPM)  format.  It  specifies  the  use 
of  functional  block  diagrams,  rather  than  logic  trees, 
for  the  presentation  of  troubleshooting  information. 

One  specification  treats  training  materials  development.  It 
is  a  basic  document  for  all  SPA  projects. 

•  MIL-M-63040  Extension  Training  Materials  -  Contains  detailed 
requirements  for  the  preparation  of  EMs  for  use  with  SPA 
TMs. 

Finally,  there  is  a  style  and  format  specification  which  is 
not  new. 

•  MIL-M-38784A,  Technical  Manual  General  Style  and  Format 
Requirements  —  Covers  the  general  style  and  format  require¬ 
ments  for  the  preparation  of  manuscripts  and  reproducible 
copy.  Included  are  examples  of  typical  formats,  illustra¬ 
tions,  etc. 

These  SPA  documents,  married  with  the  basic  LSA  data  and  pro¬ 
cessing  programs,  provide  the  ingredients  for  structuring  and  pro¬ 
ducing  the  desired  TMs  and  training  materials. 

Front  End  Analysis  —  As  was  mentioned  previously,  the  FEA  is  com¬ 
prised  of  an  equipment  functional  analysis  and  task  analyses.  The 
Army  has  developed  the  SPA  FEA  requirements  so  that,  in  the  main, 
they  can  be  in  accordance  with  MIL-STD-1388 . 

In  conducting  the  equipment  analysis,  the  Army  maintains  that 
the  MIL-M-63035  (TM)  needs  can  be  met  without  any  alteration  to  the 
normal  range  and  depth  of  the  LSA  and  that  the  deliverable  products 
can  be  provided  in  accordance  with  the  CDRL.  Furthermore,  much 
of  the  functional  analysis  data  is  collected  as  part  of  the  System/ 
Equipment  Reliability  Program  established  under  MIL-STD-785,  which 
provides  the  Failure  Mode  and  Effects  Analysis  (FMEA)  to  the  LSA 
process  through  LSA  engineering  interfacing.  However,  MIL-M- 
63035  (TM)  does  require  that  the  analysis  include  functional  block 
diagrams  for  separate  maintenance  levels.  A  task  analysis  is 
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required  by  MIL-STD-1388-1  in  the  System/Equipment  Maintainability 
Program  MIL-STD-470;  this  satisfies  the  task  analysis  specified  in 
MIL-M-63035  (TM) . 

The  behavioral  task  analysis  is  the  pivotal  point  in  the  pro¬ 
cess  because  LSA  data  is  massaged  and  structured  for  the  develop¬ 
ment  of  the  TMs  and  training  materials.  The  guidance  of  MIL-M- 
63035  (TM)  requires  a  tailoring  of  the  output  of  the  logistic 
requirements  identification  and  engineering  interfacing  tasks, 
more  specifically,  the  traditional  identification  of  technical  pub¬ 
lication  data  is  expanded  to  require  more  emphasis  and  detail  for 
cues  and  responses  associated  with  individual  task  steps.  Further¬ 
more,  the  engineering  interface  with  the  humar  engineering  program 
(MIL-H-56853A)  is  expanded  because  it  only  calls  for  detailed  human 
engineering  task  analysis  and  validation  to  be  performed  on  those 
tasks:  (1)  requiring  critical  human  performance;  (2)  reflecting 

unsafe  practices;  or  (3)  subject  to  promising  improvements  in 
operating  efficiency. 

In  the  main,  the  output  of  the  LSA  for  SPA  purposes  can  be 
accommodated  with  the  standard  LSAR  data  sheets  and  work  summaries; 
however,  sometimes  SPA  supplemental  forms,  work  sheets  or  reports 
are  required.  Where  LSAR  is  automated,  applicable  LSAR  input 
sheet  data  and  output  summaries  are  identified  for  each  LSA  prod¬ 
uct.  Where  it  is  not  automated,  the  required  SPA  products  are 
developed  manually. 

SPA  Front  End  Products  —  The  SPA  program  requires  the  contractor  to 
deliver  LSAR  data  sheets,  work  summaries,  etc.,  which  was  not  pre¬ 
viously  the  case.  The  reason  for  this  change  is  that  these  prod¬ 
ucts  are  key  to  the  design,  development  and  maintenance  of  TMs  and 
training  materials  and  they  can  be  used  to  verify  training  concepts 
and  contractor  developed  products,  or  to  permit  the  Army  to  develop 
prdducts  as  required.  The  following  discussion  provides  a  brief 
summary  of  the  products  with  reference  to  the  applicable  LSARs. 

Equipment  Breakdown  —  The  equipment  breakdown  is  a  list  of  all 
equipment  items  by  equipment  groups.  It  shows  the  next  higher 
assembly  relationships  of  all  items  on  the  list  and  includes 
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National  Stock  Numbers  (NSNs) ,  part  numbers,  Federal  Supply  Code 
for  Manufacturers,  and  reference  designators,  if  applicable. 


Tool  and  Test  Equipment  List  —  This  is  a  list  of  all  tools  and 
test  equipment,  both  special  and  common,  required  to  maintain  the 
equipment.  It  contains  a  reference  to  the  individual  tasks  listed 
on  the  Maintenance  Allocation  Chart  (MAC)  with  which  the  tools  are 
associated.  Data  displayed  on  the  list  include  the  name,  NSM,  and 
tool  number  for  each  item. 

Maintenance  Allocation  Chart  —  The  MAC  identifies  the  maintenance 
tasks  and  the  associated  man-hours  and  maintenance  levels  for  each 
reparable  item  in  the  equipment. 

Block  Diagrams  —  Block  diagrams  are  used  to  document  functional 
breakdowns  for  each  maintenance  level  and  to  display  all  inputs 
and  outputs  depicting  the  inter-relationships  associated  with  each 
functional  group. 

Functional  Descriptions  -  Functional  descriptions  describe  the  pur¬ 
pose  of  each  functional  group  defined  on  the  block  diagrams  in  the 
context  of  its  interaction  with  interconnecting  functional  groups. 
They  describe  the  inputs  and  outputs  displayed  on  the  block  dia¬ 
grams  and  are  limited  to  those  effects  which  are  observable  to  the 
senses,  either  with  or  without  test  equipment. 

Assembly  Schematics  —  Assembly  schematics  are  detailed  diagrams  in 
schematic  format  which  provide  source  and  destination  information 
on  each  input  and  output  for  each  reparable  equipment  assembly. 

Detailed  Assembly  Schematic  Descriptions  —  Detailed  assembly  sche¬ 
matic  descriptions  provide  information  on  each  assembly  schematic. 

Support  Diagrams  —  Support  diagrams  include  wiring  diagrams,  piping 
flow  diagrams,  and  cabling  diagrams  which  are  required  to  supple¬ 
ment  the  block  diagrams  and  assembly  schematics  to  ensure  that  all 
equipment  information  required  in  the  troubleshooting  process  is 
available. 
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Preliminary  Task  Development  Worksheets  -  Preliminary  task  develop¬ 
ment  worksheets  are  prepared  for  each  task  identified  on  the  MAC. 
These  data  describe  how  each  task  is  performed  and  what  related 
logistic  support  elements  are  to  perform  it.  These  elements  in¬ 
clude  tools  and  test  equipment,  expendable  items,  consumable 
items,  and  replacement  parts. 

Task  List  -  The  task  list  annotates  those  tasks  which  are  selected 
for  training  and,  using  ETM,  indicates  which  of  the  training  tasks 
are  suitable  for  formal  classroom  training  and  which  are  suitable  for 
On-the-Job  Training  (OJT) .  The  list  also  identifies  performance 
standards  required,  the  rationale  for  selecting  the  task,  and  the 
rationale  for  determining  the  recommended  training  location  (class¬ 
room  vs.  OJT) . 

Behavioral  Task  Analysis  Material  -  Behavioral  task  analysis  mater¬ 
ial  includes  identification  of  behavioral  objectives,  cues,  and 
responses  for  each  task.  Most  of  the  cue  information  is  documented 
in  graphic  form  and  integrated  with  response  information  in  written 
form. 

In  conclusion,  the  marriage  of  existing  LSA  documentation  with 
the  SPA  program  has  been  fairly  well  established.  While  bridges 
were  needed  in  some  instances,  in  general,  few  major  changes  appear 
to  have  been  required.  Nevertheless,  new  requirements  have  been 
imposed  upon  the  contractors  that  necessitated  a  reorientation  in 
their  thinking  about  ILS/LSA,  TMs,  and  training  materials.  Three 
major  changes  have  evolved:  (1)  the  delivery  of  LSA  products; 

(2)  the  working  relationship  between  their  TM  and  training  person¬ 
nel;  and  (3)  the  rigorous  scrutiny  entailed  in  the  development  of 
the  SPA  package. 

The  changes  cited  in  the  preceding  paragraph  are  leading  to 
improvements  in  the  technical  information  used  for  system/equip¬ 
ment  operations,  maintenance,  and  individual  training.  The  SPA 
and  LSA  documentation  does  not,  however,  provide  guidance  for 
specifying  or  developing  collective  training. 
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ASSESSMENT  OF  COLLECTIVE  FRONT-END  ANALYSIS 
PROCEDURES  DEVELOPED  FOR  ARTEP 

This  section  addresses  the  research  question  of  the  adequacy 
of  the  TRADOC  PAMPHLET  310-8  (Draft)  as  a  set  of  guidelines  for 
collective  training  development.  The  section  has  two  major  parts. 
The  Overview  describes  the  RADOC  approach.  The  Assessment  discusses 
the  major  strength  and  weaknesses  of  the  approach. 

Overview 

TRADOC  PAMPHLET  310-8  (Draft) ,  Collective  Front-End  Analysis 
(CFEA)  for  Development  of  Army  Training  and  Evaluation  Program 
(ARTEP) ,  was  developed  as  a  guide  to  assist  training  developers 
perform  ARTEP  mission  and  task  analysis.  This  document  reflects 
an  awareness  on  the  part  of  TRADOC  of  the  deficiency  of  procedu- 
ralization  of  collective  training  development.  As  its  title  indi¬ 
cates,  the  focus  is  on  front-end  analysis. 

In  order  to  provide  a  brief  context  of  the  CFEA,  the  follow¬ 
ing  three  definitions  are  provided: 

1.  Missions  —  Missions  are  major  Table  of  Organization  and 
Equipment  (TOE)  activities  performed  by  recognized  TOE 
echelons . 

2.  Collective  tasks  —  A  specific  action  or  actions  performed 
by  two  or  more  persons  in  the  accomplishment  of  a  unit 
mission.  These  actions,  i.e.,  tasks,  have  identifiable 
starting  and  ending  points  and  result  in  a  measurable 
accomplishment  or  product.  Tasks  are  also  discrete  and 
can  be  performed,  if  the  conditions  exist,  independently 
of  other  tasks  not  involving  the  same  personnel  and 
equipment. 

3.  Collective  front-end  analysis  (mission/task  analysis)  - 
The  analysis  process  in  which  the  TOE  capability  of  the 
unit,  the  unit  missions  (stated  and  implied) ,  the  most 
current  tactical  doctrine  and  applicable  threat  doc¬ 
trine  available  are  systematically  analyzed  and 
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integrated  to  determine  the  critical  missions  and  criti¬ 
cal  tasks  of  a  unit.  The  critical  missions/tasks  are 
then  developed  into  training  and  evaluation  outlines 
and  published  in  ARTEP  documents. 

TRADOC  PAMPHLET  310-8  (Draft)  provides  a  model  for  the  mission 
and  task  analysis  processes.  The  model's  purpose  is  to  provide  a 
path  of  actions  for  the  analyst  to  follow  in  the  development  of  an 
ARTEP.  Figure  4  presents  the  model.  The  model  may  be  described 
as  follows: 

1.  The  initial  controls  for  the  model  are  the  taskings  and 
priorities  given  to  the  analyst  and  the  appropriate 
threat.  Information  resources  are  the  only  input  to 
the  diagram. 

2.  The  manage  analytic  process  function  changes  the  infor¬ 
mation  resources  into  the  reference  material  used  by 
the  other  two  functions.  The  manage  function  also  pre¬ 
pares  material  for  the  audit  file. 

3.  The  analyze  unit  missions  function  analyzes  the  TOE  and 
the  threat.  This  results  in  an  echelon-mission-situation 
combination . 

4.  The  analyze  collective  tasks  function  develops  a  task 
list,  then  evaluates  the  criticality  and  supportability 
of  the  tasks.  Model  outputs  are  the  supported  and  un¬ 
supported  critical  task  lists  and  the  audit  file.  The 
file  also  receives  the  list  of  noncritical  tasks. 

The  following  sections  provide  a  more  detailed  description  of 
the  three  major  model  functions  of  (1)  manage  analytic  processes, 

(2)  analyze  unit  mission,  and  (3)  analyze  collective  tasks.  For 
each  function  a  brief  discussion  of  the  strengths  and  weaknesses 
of  the  underlying  procedures  is  included. 

Manage  Analytic  Process 

Managing  the  process  breaks  down  into  assembling  references, 
obtaining  advice  on  review  board  decisions,  developing  criticality 
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criteria  and  preparing  the  audit  file.  The  management  process  be¬ 
gins  by  assembling  reference  material  from  information  resources. 
This  is  done  under  the  control  of  ARTEP  development  tasking. 

A  review  board  and  subject  matter  experts  (SMEs)  are  selected 
from  an  expert  list  who  review  material  on  request  producing 
advice  or  board  decisions.  Criticality  criteria  and  judgment  pro¬ 
cedures  are  produced  under  the  guidance  of  ARTEP  tasking  and  board 
decisions.  Previous  criticality  studies,  if  any,  are  used  by  this 
function . 

An  audit  trail  is  recorded  in  an  audit  file.  It  contains  a 
description  of  all  the  other  functions  in  the  model  along  with  all 
decisions  made  and  their  justification. 

The  pamphlet  continues  to  break  down  each  of  the  subfunctions 
described  above  into  specific  processes  for  accomplishing  the  ob¬ 
jectives  of  the  fun  tion. 

Analyze  Unit  Mission 

Unit  missions  are  analyzed  by  identifying  the  echelon  contained 
in  the  unit,  developing  situations  each  echelon  may  encounter,  and 
then  identifying  missions  each  echelon  would  perform  in  the  situa¬ 
tions.  ARTEP  tasking  guides  the  identification  of  echelons  in  the 
TOE.  The  unit  and  echelon  list  is  used  with  doctrine,  terrain  and 
weather  in  the  development  of  situations  according  to  the  tasking 
and  the  threat.  The  situations  and  the  unit  echelon  list  guide  the 
identification  of  missions  from  the  TOE,  doctrine,  unit  histories, 
SME  advice  and  board  decisions.  This  results  in  echelon-mission- 
situation  combinations.  The  board  review  is  requested  when  the 
combinations  are  ready  for  review. 

Analyze  Collective  Tasks 

For  this  function  the  TRADOC  PAMPHLET  310-8  (Draft)  model  di¬ 
rects  the  training  developer  in  the  decomposition  of  the  mission- 
situation  combinations  into  tasks.  The  tasks  are  subjected  to  a 
criticality  rating  and  subsequently  reviewed  by  the  board.  Con¬ 
ditions  (primarily  the  situation  parameters)  and  standards  are  to 

provide  the  basis  for  training  objectives.  Then  the  supportability 
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of  each  task  is  determined.  Supportability  depends  upon  (1)  the 
adequacy  of  the  task  design  in  terms  of  meeting  the  mission,  (2)  and 
assessment  of  the  capability  of  the  echelon  to  perform  the  task,  and 
(3)  the  existence  of  individual  tasks,  conditions,  and  standards 
that  support  the  collective  task.  The  latter  is  the  result  of  the 
development  of  an  individual/collective  task  matrix.  There  are 
seven  sample  forms  for  documenting  the  analysis  of  collective 
tasks.  These  include  (1)  a  task  analysis  form,  (2)  a  criticality 
form,  and  (3)  an  individual/collective  task  matrix. 

Assessment 

The  TRADOC  CFEA  model  incorporates  a  number  of  data  sources 
which  are  critical  to  the  development  of  a  collective  job/task 
data  base.  Foremost  among  these  are  the  doctrine  and  threat  data 
that  to  a  large  degree  define  the  situational  contexts  for  the 
team  or  unit's  operations.  From  this  data  an  operating  continuum  — 
ranging  from  the  established  standard  operating  procedures  to 
emergent  situations  contingent  on  threat  interactions  —  can  be 
developed. 

The  CFEA  model  also  incorporates  another  developmental  fea¬ 
ture  that  appears  to  be  critical  to  the  development  of  collective 
training.  The  individual  tasks  required  to  support  a  collective 
task  are  identified.  Figure  5  presents  a  sample  individual/col¬ 
lective  task  matrix.  Within  the  context  of  missions,  collective 
tasks,  and  individual  tasks,  families  of  collective  tasks  and 
task  hierarchies  are  constructed.  Assuming  that  appropriate  and 
realistic  standards  are  applied  to  the  collective  and  individual 
tasks,  this  top-down  analytical  approach  should  result  in  a 
clear  picture  of  mission-task  relationships  and,  then,  provide 
a  sound  basis  for  developing  collective  training  strategies  and 
actual  training  scenarios.  There  are,  however,  a  number  of 
shortfalls  in  the  process. 

According  to  the  users  of  the  CFEA  model,  the  biggest  prob¬ 
lem  that  they  encounter  is  the  fact  that  the  model  ""tells  us  a 
lot  of  things  that  we  are  supposed  to  do  but  doesn't  tell  us 
much  about  how  to  do  them."  It  is  clear  that  criticism  is 
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justified.  Many  of  the  guidelines  are  insuff iciently  detailed, 
and  although  there  are  some  forms  that  support  the  process,  these 
are  inadequate.  For  example,  the  collective/individual  task 
matrix  presented  in  Figure  5  only  list  the  individual  tasks  that 
are  associated  with  a  collective  task.  The  nature  and  degree  of 
relationship  is  not  addressed.  Task  criticality,  frequency, 
impact  of  inadequate  performance,  probability  of  failure,  etc., 
are  not  determined  as  missions  change. 

A  similar  criticism  of  the  model  was  leveled  at  the  mission 
analysis  function.  First,  directions  for  performing  the  analysis 
are  not  a  step-by-step  guide.  Second,  the  product  of  this  analy¬ 
sis  is  not  well  defined.  Third,  the  model  does  not  provide  for 
a  ranking  of  the  mission  or  the  identification  of  critical  or 
capstone  missions.  In  regard  to  the  latter,  the  identification  of 

familiar  or  strands  of  collective  tasks  that  cut  across  echelons  is 

•  •  » 

dependent  on  relating  missions  and  particularly  capstone  missions. 

From  the  standpoint  of  this  investigator,  a  fourth  critical 
fault  of  the  model  is  that  it  does  not  force  the  analyst  to  identify 
operating  degradations  and  failures  which  impact  task  accomplish¬ 
ment.  This  should  be  done  for  both  human  and  machine  operations. 
Without  this  information  it  is  impossible  to  get  a  clear  picture 
of  the  collective  training  requirements. 

SUMMARY  OF  INTERVIEWS  WITH  U.S.  ARMY 
TRAINING  DEVELOPERS 

As  stated  in  the  Methodology  section,  a  part  of  the  project 
design  included  interviewing  12  training  developers  from  the  U.S. 
Army  Field  Artillery  School  (USAFAS) ,  Ft.  Sill,  Oklahoma.  The 
purposes  of  the  interviews  were  (1)  to  define  collective  training 
development  priorities,  (2)  to  identify  critical  problems  in  col¬ 
lective  training  development  for  which  team  ISD  guidelines  might 
provide  a  solution,  and  (3)  to  collect  inputs  from  training  devel¬ 
opment  that  would  be  useful  to  the  design  and  development  of  col¬ 
lective  training  procedures. 

Appendix  A  contains  an  outline  of  the  interview  scenario  as 
initially  conceived.  As  can  be  seen  in  Appendix  A,  a  basic 
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assumption  of  the  approach  was  that  there  was  formal  collective 
training  being  conducted  at  USAFAS  and  that  some  systematic  devel¬ 
opmental  process  was  in  effect.  This  was  not  the  case.  The  pre¬ 
ponderance  of  the  interviewees  were  associated  with  the  individual 
training  programs.  However,  representatives  from  the  Army  Train¬ 
ing  and  Evaluation  Program  (ARTEP)  office  were  interviewed.  The 
ARTEP  document  is  a  listing  of  the  critical  tasks  that  a  unit, 
battalion  through  gun  section,  will  have  to  perform  during  combat. 

It  was  in  fact  these  ARTEP  representatives  at  the  Ft.  Sill  office 
who  identified  the  CFEA  documentation,  ARMY  PAMPHLET  310-8  (Draft) , 
as  the  only  guidelines  that  they  had  as  support.  The  ARTEP  is  the 
heart  of  non-resident  training  and  as  such  links  individual  training 
with  collective  training  at  the  unit's  site  (as  part  of  the  ARTEP) 
as  well  as  linking  the  unit  level  collective  training  to  more  elab¬ 
orate  forms  of  collective  training  like  that  to  be  conducted  at 
the  National  Training  Center.  As  noted  in  the  prior  section,  the 
ARTEP  development  concludes  with  the  determination  of  critical 
combat  tasks,  along  with  associated  conditions  and  standards. 

It  does  not  provide  specific  guidelines  for  training  personnel 
to  perform  the  combat  tasks. 

Because  of  the  large  number  of  individual  training  developers 
and  the  limits  of  the  ARTEP  personnel  development  tasks,  the  pro¬ 
posed  interview  scenario  was  not  applicable.  Therefore,  it  was 
decided  to  make  the  interviews  less  structured,  allowing  the  inter¬ 
viewees  to  discuss  broader  issues  than  originally  intended  and  to 
bring  out  their  perceptions  of  the  range  of  issues  associated  with 
collective  training  development.  While  a  large  number  of  items 
were  discussed,  from  the  analysis  of  the  interview  tapes,  it  was 
clear  that  the  preponderance  of  the  responder's  comments  fell 
into  the  following  categories: 

1.  Status  of  TACFIRE  Team  Training 

2.  Need  for  Guidelines  for  Collective  Training  Develop¬ 
ment. 

3.  Need  for  Specifications  and  Standards  for  Contractor 
Participation  in  Collective  Training  Development. 


4.  Need  to  Get  USAFAS  Personnel  Involved  in  the  Collec¬ 
tive  Training  Acquisition  Process. 

Each  of  the  issues  are  discussed  in  the  following  subsections. 

Where  applicable,  quotes  from  the  interviews  are  incorporated . 

Status  of  TACFIRE  Team  Training 

While  there  was  some  divergence  of  views  of  TACFIRE  team 
training,  the  variance  was  only  in  regard  to  how  little  team  train¬ 
ing  is  formally  conducted.  The  following  quotes  are  typical: 

"We  don't  have  team  training  today.  We  got  a  little 
exercise  that  involves  more  than  one  person  but  it  is 
to  evaluate  operators  —  individual  operators." 

"No,  we  don't  really  attempt  to  train  them  together. 

The  CPX  is  training,  but  it's  probably  more  a  test." 

"The  team  training  is  a  tape  where  the  individual  sits 
at  the  trainer  and  it  looks  like  there  are  other  peo¬ 
ple  there.  The  tape  —  computer  —  simulates  the  opera¬ 
tor's  actions." 

The  USAFAS  training  developers  did  express  a  need  for  more 
collective  training.  Additionally,  they  identified  problems  that 
would  be  encountered  in  a  significant  upgrade  of  the  collective 
training.  The  problems,  pointed  out  in  the  following  quotes,  in¬ 
clude  (1)  lack  of  talent  to  use  the  computer  although  the  trainer 
is  a  major  response,  (2)  lack  of  direction  in  the  training,  and 
(3)  lack  of  time. 

"Well,  we  should  be  doing  more  team  training  here  at 
the  school,  but  our  way  involves  using  the  computer. 

So  we  have  to  train  someone  to  use  the  computer 
language.  That  means  we  have  to  have  someone  trained 
in  PLANIT  for  the  individual  training  and  someone 
trained  in  the  team  language,  whatever  it's  called, 
for  the  team  training.  Also,  scenarios  are  really 
just  event  sequences  that  go  faster  or  slower  on  dif¬ 
ferent  memories.  We  don't  try  to  represent  Afghanistan, 


Europe,  South  Africa  or  special  conditions.  We  also  don’t 
really  represent  an  enemy  or  opposing  force.  We  need  to 
make  these  scenarios  better." 

"I  don't  think  that  there's  anything  that  gives  us  any 
tips  or  direction  on  how  to  prepare  a  scenario  that 
would  train  better.  A  lot  of  the  time  we  don't  know  just 
what  we  should  be  training.  The  ARTEP  may  tell  us  more 
about  that." 

"We've  never  really  looked  at  doing  cross-training  or  any 
thing  that  might  lead  to  better  crew  performance  other 
than  to  try  to  improve  performance  of  the  individual 
operators.  It  seems  like  we  don't  have  enough  time  to 
do  that . " 

Need  for  Guidelines  for  Collective  Training  Development 

"310-8  [TRADOC  PAMPHLET  on  Collective  Front-End  Analysis] 
is  the  definitive  guide  to  front-end  analysis  —  well  I 
mean  by  definitive  that  it's  the  only  thing  we  have.” 

This  quote  from  an  ARTEP  representative  at  Ft.  Sill  summed 
up  the  responses  to  an  inquiry  regarding  the  need  for  guidelines 
for  collective  training  development.  The  shortcomings  of  PAMPHLET 
310-8  were  discussed  but  it  is  worth  noting  that  the  major  draw¬ 
back  and  criticism  of  the  model  was  that  although  it  contained 
no  less  than  46  direct  steps  none  were  defined  in  great  detail. 
Further  the  model  only  addressed  CFEA  and  was  not  a  guide  to  the 
design  or  development  of  training. 

Another  analysis  problem  is  associated  with  the  model,  but 
certainly  is  not  inherent  to  it.  That  is,  the  doctrine  that  is 
analyzed  is  frequently  inconsistent  or  insufficient. 

"There's  not  always  consistency  down  through  the 
echelons.  In  developing  task  hierarchies  and  fam¬ 
ilies,  some  capstone  missions  did  not  track  from 
battalion  to  gun  crew,  some  were  not  supportable 
just  because  of  doctrine." 


In  regards  to  the  lack  of  doctrine  in  some  areas,  the  follow¬ 
ing  quotes  clearly  describe  the  situation: 

"A  lot  of  money  is  spent  writing  documents  for  the 
field  artillery  battery,  6-50.  We  write  handbooks  for 
the  executive  officer,  handbooks  for  the  battery  com¬ 
manders,  we  write  documents  for  the  fire  direction 
center  —  right  within  the  battery.  But  what  do  we  do 
with  headquarters  battery.  Without  headquarters  battery, 
without  service  battery,  a  firing  battery  would  last  in 
combat  probably  half  a  day.  We  never  write  any  doc¬ 
trine  for  headquarters  battery." 

"What  does  the  battalion  do?  The  command  and  staff, 
the  operations,  the  S-4,  and  supply  and  all  of  those 
things  that  are  going  to  interact  on  us  in  combat  — 
what  do  they  do  for  a  living  to  support  us?" 

The  lack  of  doctrine  covering  an  operation  or  functional  group¬ 
ing  is  not  the  fault  of  the  model.  In  fact  it  points  out  a  strength 
of  the  model  in  that  it  reveals  discrepancies  in  the  system.  But  a 
consideration  of  a  comprehensive  collective  training  model  must  be 
how  to  handle  doctrine  gaps,  inconsistencies,  or  other  discrepan¬ 
cies  . 

Another  problem,  and  a  very  critical  one,  emerged  from  responses 
to  the  question  of  what  is  an  ARTEP  and  how  is  it  used.  The  ARTEP 
is  "listing  of  the  critical  tasks  that  a  battery  and  battalion  will 
have  to  perform  in  combat."  An  ARTEP  should  point  out,  for  example, 
the  multiperson  tasks  that  "a  gun  chief  knows  his  crew  has  to  do  — 
emplace  a  cannon,  lay  a  cannon,  perform  a  prefire  check,  fire  the 
howitzer."  Unfortunately  the  ARTEP  "has  been  bastardized  into  a 
test."  It  is  frequently  stated  that  the  ARTEP  is  a  measure  of 
reactions,  not  a  training  tool. 

It  was  noted  that  the 

"major  reason  that  the  ARTEP  has  become  a  readiness  test 
is  that  nobody  knows  how  to  use  them  and  the  way  they 
are  set  up  they  do  look  like  test  objectives  or  like  the 
answer  sheet." 
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"I  used  the  ARTEP  to  develop  a  training  scenario;  a 
motor  pool  exercise.  I  gave  them  the  general  threat 
condition  which  would  initialize  the  system,  described 
the  Op  force,  doctrine,  initialization  data,  support 
requirements  -  personnel  and  equipment  to  support 
training,  training  and  evaluation  standards,  and  tips 
to  trainers  and  evaluators.  They  were  good  exercises, 
but  most  of  these  guys  don't  know  how  to  use  the 
ARTEP . " 

Need  for  Specifications  for  Contractor  Developed 
Collective  Training  Materials 

"Existing  specifications  are  widget  oriented  and  are 
more  concerned  with  getting  manuals  and  individual 
maintenance  [training].  We  get  no,  absolute  no, 
collective  training  data  from  the  contractor." 

In  response  to  the  question  of  "how  could  contractors  support 
collective  training  development'  there  was  some  disagreement  as  to 
what  specifically  was  needed  from  the  contractor.  But  there  was 
unison  in  the  confirmation  of  the  need.  Some  quotes  discussing 
what  the  contractor  could  do  are  as  follows: 

"We  need  a  list  of  collective  tasks  that  are  equip¬ 
ment  peculiar." 

"I  need  tifties  —  conditions  and  standards  for.  the 
operating  system. " 

"The  contractor  could  also  do  a  lot  of  the  cross¬ 
match  between  the  individual  and  collective  tasks." 

"Platoon  leaders,  I  believe,  are  responsible  for  train¬ 
ing  their  teams  and  they  should  be.  They  should  write 
the  scenarios,  not  contractors,  because  they  know  how 
their  unit's  operating  characteristics  better  than 
anyone  else.  But  they  don't  have  time  for  it  and 
they  don't  have  guidelines  for  developing  scenarios." 
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"Also  the  entire  FEA  documentation  should  be  delivered 
because  of  the  large  number  of  models  that  we  get." 

Asking  why  contractor  support  is  necessary  did  not  yield  any 
surprises  but  the  major  response  is  worth  noting. 

"Resources,  one  of  the  problems  resources,  we  have 
over  22  courses  being  taught.  We  can't  do  all  the 
things  that  we  would  like  to  because  we  don't  have  the 
bodies,  dollars,  whatever.  Every  time  we  have  to  do  a 
new  task  or  rewrite,  revise  a  contractor's  job,  like 
redoing  a  TA,  we  have  to  take  it  out  of  hide  using 
people  that  are  already  doing  important  jobs.  Every 
[body]  in  the  Army  has  the  same  problem  and  we  know 
that  we  won't  ever  have,  and  probably  don’t  deserve, 
all  the  money  and  people  we  would  like.  But  we  should 
be  able  to  get  more  usable  products  from  the  contractors." 

A  final  issue  that  was  discussed  was  how  to  get  the  contrac¬ 
tor  to  deliver  useful  collective  training  data. 

"We  got  to  have  a  set  of  guidelines  for  the  contractor 
just  like  we  have  —  or  need  —  it  should  be  the  same 
set." 

Although  there  was  not  much  discussion  of  the  specific  con¬ 
tent  of  the  specifications,  some  important  concerns  for  both  con¬ 
tractors  and  government  were  raised: 

"One  of  the  problems,  I  feel,  is  that  too  much  of  this 
LSA,  task  analysis  and  so  on  is  not  understood  by  the 
contractor.  They  don't  know  what  we  need  for  training. 

And  we  don't  know  sometimes.  When  we  started  getting 
lessons  in,  we  didn't  like  them.  So  we  had  to  start 
changing  them.  Which  cost  us,  the  people  here  a  lot 
of  money  to  have  to,  you  know,  redo  that  stuff.  It 
cost  us  a  bunch.  We  really  didn’t  know  what  to  expect 
but  we  have  a  hell  of  a  lot  more  experience.  Both  of 
us  [the  contractor  and  school  personnel]  need  better 
specs  on  training  ourselves." 
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"A  set  of  specifications  to  be  used  by  the  contractor 
should  also  have  the  tools  in  it  to  make  the  contractor 
comply  with  the  SOW  and  be  sure  that  the  deliverables 
are  what  we  want.  PRs,  OA  standards,  and  such  should 
be  referenced  in  the  contract." 

Need  to  Get  Collective  Training  Personnel 
involved  in  the  Acquisition  Process 

Another  consideration  associated  with  the  procurement  of  con¬ 
tractor  developed  collective  training  materials  is  how  to  specify 
what  is  required.  The  response  was  to  get  the  collective  training 
developer  involved  in  the  process  early.  The  SPA  approach,  as 
pointed  out  in  a  prior  section,  is  based  on  a  marriage  between 
TRADOC  and  DARCOM.  It  was  pointed  out  that  on  at  least  one  occasion 
this  occurred.  We  requested: 

"A  list  of  Pershing  II  equipment  related  collective  tasks 
developed  in  accordance  with  TRADOC  PAMPHLET  310-8  (Draft) 

CFEA,  paragraph  1-3-D,  will  be  provided." 

"Normally  we  do  not  get  to  make  these  inputs.  We  have 
no  license  to  get  involved,  but  we  need  to  get  on  board 
early  as  training  planners  and  be  involved  throughout 
the  early  phases  of  the  life  cycle.  We  then  could  have 
a  draft  ARTEP  and  team  training  ready  for  OT  II.  We 
could  check  our  conditions  and  standards  in  the  ARTEP, 
and  we  could  have  given  the  test  team  training." 

A  point  made  earlier  was  then  reiterated: 

"Getting  into  the  cycle  is  only  a  part  of  it.  We  still 
must  get  good  materials  —  tasks  lists  and  instruction, 
if  delivered  —  from  the  contractors.  And  I'm  not  sure 
they  know  how  to  develop  the  things  we  need." 


k 


CONCLUSIONS 


The  conclusions  sections  addresses  the  fifth  research  question 
posited  in  the  Introduction:  What  aspects  of  collective  training 
analysis,  design,  and  development  continue  to  present  problems  to 
the  collective  training  developer?  When  this  question  was  first 
raised,  it  was  assumed  that  significant  amounts  of  collective 
training  were  being  conducted  at  the  artillery  school  at  Fort 
Sill.  It  was  further  anticipated  that  by  examining  these  collective 
training  efforts  and  by  interviewing  the  training  developers,  spe¬ 
cific  problems  encountered  during  collective  training  ISD  could  be 
clearly  identified.  As  indicated  in  the  preceding  sections,  there 
was  only  a  minimal  amount  of  training,  that  could  be  construed  as 
collective  training,  being  conducted.  Instead  of  being  able  to 
define  specific  problems,  two  general  conclusions  were  drawn: 

(1)  there  is  a  need  for  a  full  set  of  detailed  collective  training 
guidelines,  and  (2)  there  is  a  need  for  contractor  support  for  col¬ 
lective  training,  especially  for  analysis  tasks. 

In  regard  to  the  first  general  conclusion,  the  usability  of 
the  individual  ISD  model's  procedures  for  collective  training  devel¬ 
opment  was  investigated.  It  was  found  that  the  application  would 
be,  at  best,  a  force  fit.  The  model  does  lend  itself  to  be  used 
as  guidelines  for  the  categorization  and  organization  of  ISD  activ¬ 
ities.  The  Interservice  ISD  model  is  a  good  representation  of  the 
many  activities  that  go  into  establishing  good  individual  training. 
However,  the  specific  procedures  in  the  ISD  model  will  not  lead  to 
effective  collective  training. 

In  regard  to  the  conclusion  that  collective  training  should 
become  a  contractor  concern  as  well  as  being  addressed  within  in- 
house  developmental  programs,  there  remains  a  problem  of  the  lack 
of  specifications  and  guidelines.  Not  only,  then,  must  the  collec¬ 
tive  ISD  procedures  be  definitive  enough  to  be  used  by  trained 
Army  personnel,  but  also  they  must  be  precise  enough  to  ensure 
that  the  products  delivered  by  various  contractors  meet  the  required 
standards.  Concommitant  to  acquiring  collective  training  data 
(from  CFEA  results  to  instruction)  is  the  involvement  of  collective 
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training  developers  in  the  acquisition  process  as  TRADOC  represen¬ 
tations.  Further,  if  effective  collective  training  is  to  be  a  con¬ 
tract  deliverable,  there  needs  to  be  a  collective  training  focus 
at  IPRs  and  validation  activities. 

In  addition  to  examining  the  ISD  model  for  applicability  for 
collective  training  development,  two  other  sets  of  procedures  were 
reviewed:  (1)  the  ARTEP  CFEA  procedures  set  forth  by  TRADOC,  and 

(2)  the  procedures  underlying  the  development  of  Skill  Performance 
Aids  (SPA) .  The  CFEA  guidelines  are  broken  down  into  a  large  num¬ 
ber  of  'steps,'  but  the  steps  are  not  well-defined.  Interviews 
with  ARTEP  personnel  indicates  that  the  CFEA  guidelines  need  con¬ 
siderably  more  detail,  more  forms  and  structured  worksheets  to 
support  the  analysis  activities,  and  more  examples  illustrating 
the  products. 

The  SPA  development  procedures  are  dependent  upon  LSA  for  front 
end  analysis.  The  investigation  of  the  SPA  and  LSA  documentation 
revealed  that  neither  was  designed  to  address  collective  training 
development. 
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RECOMMENDATIONS 


1.  Investigate  the  modification  of  LSA  to  incorporate  the  follow¬ 
ing  features: 

a.  Provide  a  more  usable  format  and  collection  of  individual 
maintenance  task  data. 

b.  Provide  for  the  identification  of  operator  tasks  along 
with  associated  skills  and  knowledges. 

c.  Identify  equipment  peculiar  collective  training  tasks. 

2.  Improve  TRADOC  PAMPHLET  310-8  by  more  precisely  defining  the 
46  identified  processes  and  by  developing  additional  support 
documentation. 

3.  Develop  a  trainer's  guide  to  support  ARTEP  objectives.  The 
basic  feature  of  such  a  guide  or  handbook  would  be  as  follows: 

a.  Training  Scenario  Development 

b.  Sequencing  Training 

c.  Training  Tips  (motivation,  organization,  instruction) 

d.  Observation  and  Evaluation  Techniques 

e.  How  to  Use  Knowledge  of  Results  and  Feedback 

4.  Develop  a  counterpart  of  the  trainer's  guide  for  the  training 
developer's  responsibilities  beyond  the  CFEA,  with  particular 
focus  on  design  and  development  activities.  The  Interservice 
Procedures  should  serve  as  an  organization  and  context  guide. 
New  procedures,  resulting  in  sound  collective  training  mater¬ 
ials,  need  to  be  developed. 

5.  The  four  previous  recommendations  should  be  augmented  with  a 
Contractor-Developed  Collective  Training  Military  Standard 
which  contains  all  guidelines,  standards  of  performance,  Data 
Item  Descriptions,  and  a  QA  program  that  is  equally  as  inten¬ 
sive  and  demanding  as  the  program  associated  with  the  acquisi¬ 
tion  of  training  under  the  Skills  Performance  Aids  concept. 
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APPENDIX  A 

INTERVIEW  SCENARIO 


Time 

Minutes 


0-3 


4-10 


11-30 


1 


INTERVIEW  SCENARIO 


_ Activity _ 

Collect  biographical  data 
State  purpose  of  the  interview 

Describe  interviewee  ISD  background 
What  type  of  training 
How  much  training 
Describe  training 
How  much  experience 
What  type  of  experience 
Analysis 
Design 
Development 

Describe  in  detail  ISD  task  performed 
Describe  types  of  documentation  prepared 

Describe  TACFIRE  materials  production  techniques 
Analysis 

Task  Analysis  (TA) 

What  materials  are  used  in  TA 

Are  interviews  used.  Surveys.  Describe. 

How  Much  do  SMEs  contribute 

How  are  the  following  identified  and  defined 
Communication  tasks 
Attitude  requirements 
General  knowledge  of  team  roles 
Construct  Performance  Measures 
How  are  proficiencies  established 
Are  team  member  interaction  errors  identified 
What  criticality  criteria  are  employed 
Are  compensatory  behaviors  identified 
Design 

Develop  Objectives 

Are  team  objectives  developed 
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INTERVIEW  SCENARIO  (Cont'd) 

Time 

Minutes  _ Activity _ 

11-30  Design  (Cont'd) 

Cont  d  do  jSD  0bjectives  classification  schemes 

lend  themselves  to  developing  team 
obj  ectives 

Describe  Entry  Behavior 
Techniques  used 
Variables  considered 
Are  team  characteristics  considered 
Determine  Scope  and  Sequence 

Are  hierarchical  schemes  used 
Are  team  learning  tasks  sequenced 
How  are  scenarios  constructed 
Development 

How  are  instructional  strategies  developed 
How  is  media  selected 

Are  instructional  management  plans  developed 

41-65  Review  and  Analysis  of  Proposed  Team  Training  Procedures 

Each  section  will  be  reviewed  and  analyzed 

Interviewee  will  be  asked  to  judge  the  adequacy, 
feasibility,  and  labor-intensity  of  each 
step  . 

66-75  Recommendations  (Summary) 

Final  recommendations  to  each  section  will  be 
refined 
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